-
Notifications
You must be signed in to change notification settings - Fork 7
Open
Labels
suggestionIdeas or proposals for improvementIdeas or proposals for improvement
Description
I'd like to notify you that, from line 74 to 78 of the answer_extractor.py file, the model is download on a local directory which does not match the standard huggingface .cache path. This causes an useless structural overhead. Moreover, the files are saved in .bin format, which also require more disk space. Note that the AutoModelForCausalLM.from_pretrained() method already takes into account the case in which the model is a local path or an huggingface model id, therefore there is no need to implement these 4 lines of code. You can safely remove them and allow HF to handle the download / load of your models.
Metadata
Metadata
Assignees
Labels
suggestionIdeas or proposals for improvementIdeas or proposals for improvement