Missing chunks in data - is it normal? #128
Answered
by
mzouink
fgdfgfthgr-fox
asked this question in
Q&A
-
Beta Was this translation helpful? Give feedback.
Answered by
mzouink
Dec 22, 2024
Replies: 1 comment
-
Hi, yes, the default data fetcher, download only the raw blocks that are annotated and they have a GT blocks. You can check the annotated blocks for each dataset here If the padding reach the total size of the raw the script will download the full raw dataseet. (check storage) |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
rinva
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi, yes, the default data fetcher, download only the raw blocks that are annotated and they have a GT blocks.
You can check the annotated blocks for each dataset here
If you want to fetch more raw you can parametrize --raw-padding
e.g.
csc fetch-data --raw-padding 128
If the padding reach the total size of the raw the script will download the full raw dataseet. (check storage)