Skip to content

Reduce the no of threads spun up to download files from Minio #332

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
prajwalkkumar opened this issue Dec 4, 2023 · 1 comment
Open

Reduce the no of threads spun up to download files from Minio #332

prajwalkkumar opened this issue Dec 4, 2023 · 1 comment
Assignees
@ponyisi
Milestone
3.2 New features

Comments

@prajwalkkumar
Copy link

In dataset group operations, owing to the large number of datasets, a large number of threads are spun up to download files. We want to reduce the number of threads to a threshold or run everything in a single thread for a single dataset.
@ponyisi ponyisi added this to the 3.1 New features milestone Sep 5, 2024
@ponyisi ponyisi self-assigned this Jan 31, 2025
@ponyisi
Copy link
Collaborator

ponyisi commented Apr 8, 2025

Fixed by #579

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ponyisi ponyisi

Labels
None yet
Projects
None yet
Milestone
3.2 New features
Development

No branches or pull requests
2 participants
@ponyisi @prajwalkkumar