Skip to content

Avoid rate-limiting issues when retrieving remote PEtab problems #2738

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
dweindl opened this issue May 18, 2025 · 3 comments
Open

Avoid rate-limiting issues when retrieving remote PEtab problems #2738

dweindl opened this issue May 18, 2025 · 3 comments
Assignees
Labels

Comments

@dweindl
Copy link
Member

dweindl commented May 18, 2025

Since a couple of days or weeks, we are frequently running into rate-limiting issues when downloading PEtab problems from https://raw.githubusercontent.com/ leading to test failures (e.g., https://github.com/AMICI-dev/AMICI/actions/runs/15093799099/job/42425779408).

Cloning the full repository would be an alternative, but sometimes it would be more convenient to only access the relevant files. See also Benchmarking-Initiative/Benchmark-Models-PEtab#264. An alternative might be adding some delay for retrieving the individual PEtab files in libpetab.

@dweindl dweindl added the ci label May 18, 2025
@FFroehlich
Copy link
Member

FFroehlich commented May 18, 2025

@dweindl
Copy link
Member Author

dweindl commented May 18, 2025

Ah, yeah, https://github.blog/changelog/2025-05-08-updated-rate-limits-for-unauthenticated-requests/ is the relevant update.

The documentation doesn't make it immediately clear to me how the rate-limit for https://raw.githubusercontent.com/ can be circumvented, though. We're not using the GitHub REST API.

@dweindl
Copy link
Member Author

dweindl commented May 18, 2025

From my understanding, gh-pages is not subject to any relevant rate-limiting, so just deploying the working tree should be the simplest solution for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants