Ollama Support?

[mrjones2014]

I've recently been using Ollama, which basically provides a unified REST API interface to any open source LLM model, with Open-WebUI, which basically gives a completely offline local ChatGPT-like experience.

Any chance we could make like an API adapter or something to make this plugin work with a local Ollama API?

[mrjones2014]

Even better would be to use the Open-WebUI API directly, as that project adds some features like chat history etc.

[olimorris]

Great timing. I only came across Ollama a couple of days ago. Looks like integration would be pretty straight forward given the API structure but yep, will need adapters. The code base is verrrrryyyyyyyy tightly coupled to OpenAI.

[mrjones2014]

Amazing, maybe I can find some time this weekend to really dig into the code to help out.

[olimorris]

I've made a first stab at what an adapter would look like in a PR.

[mrjones2014]

Hey @olimorris I'm trying this out and I'm getting this error:

CodeCompanion Error executing Lua callback: .../share/nvim/lazy/lazy.nvim/lua/lazy/core/handler/cmd.lua:48: Vim:Error executing Lua callback: ...decompanion.nvim/lua/codecompanion/strategies/inline.lua:224: attempt to call method 'set_params' (a nil value)
stack traceback:
	...decompanion.nvim/lua/codecompanion/strategies/inline.lua:224: in function 'inline'
	/home/mat/git/codecompanion.nvim/plugin/codecompanion.lua:12: in function </home/mat/git/codecompanion.nvim/plugin/codecompanion.lua:11>
	[C]: in function 'cmd'
	.../share/nvim/lazy/lazy.nvim/lua/lazy/core/handler/cmd.lua:48: in function <.../share/nvim/lazy/lazy.nvim/lua/lazy/core/handler/cmd.lua:16>
stack traceback:
	[C]: in function 'cmd'
	.../share/nvim/lazy/lazy.nvim/lua/lazy/core/handler/cmd.lua:48: in function <.../share/nvim/lazy/lazy.nvim/lua/lazy/core/handler/cmd.lua:16>

[olimorris]

Great spot and such a dumb mistake on my part. Fixed that in the latest commit

[mrjones2014]

lol, no worries, I have definitely done stuff like that 😛

[olimorris]

Let me know how you're finding it!

[mrjones2014]

Awesome so far! There's a few rough edges (some I've already done PRs for 😛) but for the most part it its very awesome.

[olimorris]

Great to hear. It genuinely changed my workflow in Neovim for the better. Lot's more I'd like to add to it in time.

Oh and there's some handy keymaps to work with the chat buffer btw.