Improve Data Loading Times #9590
Unanswered
FabianSchuetze
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Thanks for this wonderful repo. It is a pleasure to work with it.
This is not a bug or a feature request, just a simple question: Do you have any suggestions for reducing the data time during training an instance segmentation model? The masks are stored as rle and the images as jpgs.
The dataset I work with has about ~30-50masks per image. With the augmentations defined in Mask R-CNN the data time takes 0.5 (the total processing time is ~2). I set the number of data workers equal to the number of CPU cores. When working with the aggressive augmentations of RTMDet and setting
poly2mask=True
, the loading time is unbearable and I cannot train the network.PolygonMasks
can be more efficient. Would you advise me to change the formats?Beta Was this translation helpful? Give feedback.
All reactions