LocalLLM?

[Chrusciki]

is there a way to set a local hosted LLM (or multiple like stable, whisper, tortis, a LLaMa)?

[yashbonde]

Hey we are modifying the underlying engine that will enable you to plug in your own local servers. You can track the progress in #101.