use different LLMs

[ifeue]

I'm writing App which provides the ability that different user can use different LLM (different provider, different model, etc.). User can change LLM model from a configuration file. Please advise how can I handle the different LLMs with same code. Any pattern I can use in Rig?

[joshua-mo-143]

Hi, the current state of LLM clients means you will likely need to write an enum wrapper:

enum Provider {
    OpenAI(rig::provider::openai::Client),
    // .. the rest of your providers here
}

We're taking a stab at dealing with this exact issue in #440 but for now, this is probably the closest thing you're going to get to a solution.