Skip to content

Issue while downloading model using huggingface model path #9

@framolfese

Description

@framolfese

I'd like to notify you that, from line 74 to 78 of the answer_extractor.py file, the model is download on a local directory which does not match the standard huggingface .cache path. This causes an useless structural overhead. Moreover, the files are saved in .bin format, which also require more disk space. Note that the AutoModelForCausalLM.from_pretrained() method already takes into account the case in which the model is a local path or an huggingface model id, therefore there is no need to implement these 4 lines of code. You can safely remove them and allow HF to handle the download / load of your models.

Metadata

Metadata

Assignees

No one assigned

    Labels

    suggestionIdeas or proposals for improvement

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions