Ideas of LLM Providers to Implement in gollm

[teilomillet]

We're always looking to expand gollm's capabilities by adding support for more LLM providers.

If you're interested in contributing, here's a list of providers we'd love to see integrated:

• Mistral
• Cohere
• OpenRouter
• Lambda Labs
• Google (VertexAI)
• AWS Bedrock
• Microsoft Azure

This list is not exhaustive or in any particular order. If you're interested in working on one of these providers or have another provider in mind:

• Check our CONTRIBUTING.md for guidelines on how to contribute.
• Feel free to ask any questions if you need help or clarification.

We welcome suggestions for other providers not on this list. If you think another provider would be a valuable addition to gollm, please let us know!

We'll update this list as new suggestions come in or as providers are successfully integrated. Keep an eye on this issue for the latest opportunities to contribute!

Thank you !

[go-dockly]

https://huggingface.co/chat/
https://www.orbitfin.ai/
https://finchat.io/

[lorenzomainardi]

What about Ollama? Do you support it?

[teilomillet]

@lorenzomainardi yes Ollama is supported, please check the example to know more about it : https://github.com/teilomillet/gollm/blob/main/examples/ollama_example.go

or the code if you know more about it :
https://github.com/teilomillet/gollm/blob/main/providers/ollama.go

[andrejsstepanovs]

Is there a way to inject my own provider and use it?

I would need SetProviderRegistry() or SetProvider() for that. Would be nice.

UPDATE

There is another NewLLM() that dont have so much magic, but allows you to pass custom providers. See example:

import(
    "github.com/teilomillet/gollm"
    "github.com/teilomillet/gollm/llm"
    "github.com/teilomillet/gollm/providers"
    "github.com/teilomillet/gollm/utils"
)

cfg, err := gollm.LoadConfig()
if err != nil {
	log.Fatalf("Failed to load config: %v", err)
}

registry := providers.NewProviderRegistry()
registry.Register("deepseek", func(apiKey, model string, extraHeaders map[string]string) providers.Provider {
        // create your own (copy & extend OpenAIProvider)
	return NewCustomOpenAIProvider(
		"deepseek",
		"https://api.deepseek.com/chat/completions",
		apiKey,
		model,
		extraHeaders,
	)
})

cfg.Provider = provider
cfg.APIKeys = map[string]string{provider: apiKey}
cfg.Model = model
conn, err := llm.NewLLM(cfg, utils.NewLogger(cfg.LogLevel), registry)