-
Notifications
You must be signed in to change notification settings - Fork 657
Description
we need to fix the sentence transformer download, it fails all the time with 429 errors when trying to start the container
either we need to bake it into the container or we need to download it from an URL that we control like a GCS bucket
https://milvus.io/ai-quick-reference/if-the-sentence-transformer-model-downloads-from-hugging-face-are-very-slow-or-failing-what-can-i-do-to-successfully-load-the-model
milvus.iomilvus.io
If the Sentence Transformer model downloads (from Hugging Face) are very slow or failing, what can I do to successfully load the model?
If you're experiencing slow or failed downloads when loading a Sentence Transformer model from Hugging Face, there are s (127 kB)
Error Logs-----------
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1533, in _get_metadata_or_catch_error
metadata = get_hf_file_metadata(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1450, in get_hf_file_metadata
r = _request_wrapper(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 286, in _request_wrapper
response = _request_wrapper(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 309, in _request_wrapper
response = http_backoff(method=method, url=url, **params, retry_on_exceptions=(), retry_on_status_codes=(429,))
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 317, in http_backoff
response.raise_for_status() # Will raise uncaught exception
File "/usr/local/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json