Replies: 1 comment
-
I added:
to short circut |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I attempted to pull a very small file
dvc pull -r aws train_labels.csv.dvc -vvv
, and I it took nearly a minute to finish. I added the-vvv
to give me a sense as to what was going on, and I noticed a ton of "collecting stages" messages:You can see the command starts at
21:35:53
and starts "collecting stages" 7 seconds later at21:36:00,221
, it then continues to collect stages for until21:36:39
, nearly 40 seconds later, and then it finally after 4 more seconds.I don't use DVC for pipelines, I've never used a stage. All I use it for is git-for-data, which it's great for... until I start adding lots of files to a single repo, and then I run into issues like this. Is there anyway to disable these stage checks? I see in #7093 there is an item
stop collecting whole DAG all the time in the whole repo
, is that related to this?Beta Was this translation helpful? Give feedback.
All reactions