Local model

[Nihir2904]

Heyy, what changes should make to run a local model on it?
I have a llama-2b model.

[elebitzero]

Hi @Nihir2904,

Currently, this project is only targeted for the OpenAI API https://api.openai.com/v1/chat/completions and doesn't work with local models.