-
Notifications
You must be signed in to change notification settings - Fork 4
Short term index cache #72
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
If we add a cache we could reasonably consider making it longer than 5 minutes, as we make releases on the order of months. I'm maybe biased though by the constant 40MB conda index downloads! A |
The thing about a longer cache is then we need to do network calls to check whether to invalidate it. For a very short one, we're really just trying to catch a flurry of calls (e.g. a user doing |
And yeah, I'm all too familiar with these. It's why I set up the index chaining system like I did. I just repartitioned (#5), so now we have:
Most people just doing installs/updates will only get the first one (27KB). You only see the rest if you ask for a specific version that isn't the latest. New releases will always go into the first, so eventually it'll bloat, but we can repartition whenever we want to balance them again. |
We should probably cache the index locally for a short period of time (e.g. 5 minutes), to more efficiently handle rapid queries.
The period should be short enough to not really worry about other invalidation mechanisms - we can just skip the network traffic entirely. Passing
-f
should skip it, of course.The text was updated successfully, but these errors were encountered: