Skip to content

sentence transformer download is fails while container is up #1349

@praveshkumar1988

Description

@praveshkumar1988

we need to fix the sentence transformer download, it fails all the time with 429 errors when trying to start the container
either we need to bake it into the container or we need to download it from an URL that we control like a GCS bucket
https://milvus.io/ai-quick-reference/if-the-sentence-transformer-model-downloads-from-hugging-face-are-very-slow-or-failing-what-can-i-do-to-successfully-load-the-model
milvus.iomilvus.io
If the Sentence Transformer model downloads (from Hugging Face) are very slow or failing, what can I do to successfully load the model?
If you're experiencing slow or failed downloads when loading a Sentence Transformer model from Hugging Face, there are s (127 kB)

Error Logs-----------
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1533, in _get_metadata_or_catch_error
metadata = get_hf_file_metadata(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1450, in get_hf_file_metadata
r = _request_wrapper(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 286, in _request_wrapper
response = _request_wrapper(
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 309, in _request_wrapper
response = http_backoff(method=method, url=url, **params, retry_on_exceptions=(), retry_on_status_codes=(429,))
File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 317, in http_backoff
response.raise_for_status() # Will raise uncaught exception
File "/usr/local/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url: https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json

Metadata

Metadata

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions