Skip to content

parallelize tests #509

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Jun 14, 2025
Merged

parallelize tests #509

merged 15 commits into from
Jun 14, 2025

Conversation

jiajun-unstructured
Copy link
Contributor

@jiajun-unstructured jiajun-unstructured commented Jun 5, 2025

This repo doesn't have access to the self-hosted-xlarge runner for more cores, so this change will only start 2 workers

@jiajun-unstructured jiajun-unstructured force-pushed the jiajun/test-parallel branch 4 times, most recently from 1528184 to 6d13dc3 Compare June 10, 2025 23:04
@jiajun-unstructured jiajun-unstructured marked this pull request as ready for review June 11, 2025 21:55
# via jupyter
notebook-shim==0.2.4
# via
# jupyterlab
# notebook
numpy==1.26.4
# via
# -c requirements/constraints.in
# -c /Users/jiajunxu/code/unstructured-api/requirements/constraints.in
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pip-compile loves to add absolute paths in the comments, so you need to delete them all :D

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done.

@PastelStorm PastelStorm force-pushed the jiajun/test-parallel branch 2 times, most recently from 518c3d8 to d6182af Compare June 13, 2025 01:08
@PastelStorm PastelStorm force-pushed the jiajun/test-parallel branch from 396ed2a to a4c87c1 Compare June 13, 2025 04:02
@PastelStorm PastelStorm merged commit 6108dd3 into main Jun 14, 2025
6 checks passed
@PastelStorm PastelStorm deleted the jiajun/test-parallel branch June 14, 2025 03:21
@PastelStorm
Copy link
Contributor

This repo doesn't have access to the self-hosted-xlarge runner for more cores, so this change will only start 2 workers

Very strange that public repos have access to 4 cores but we only get 2 workers with -n auto:

created: 2/2 workers
2 workers [145 items]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants