Function callers in Azure OpenAI

[strayer]

I'm primarily using Azure OpenAI and wondered if I can get function calling working there. Since the APIs usually match pretty well I tried just copying over the relevant function calling code, but that didn't seem to help:

  adapters = {
    azure_openai = function()
      local openai = require("codecompanion.adapters.openai")
      return require("codecompanion.adapters").extend("azure_openai", {
        env = {
          api_key = 'cmd:redacted',
          endpoint = 'cmd:redacted',
          api_version = "2024-12-01-preview",
        },
        roles = {
          llm = "assistant",
          user = "user",
          tool = "tool",
        },
        opts = {
          stream = true,
          tools = true,
        },
        schema = {
          model = {
            default = "gpt-4.1",
          },
        },
        handlers = {
          --- Use the OpenAI adapter for the bulk of the work
          setup = function(self)
            return openai.handlers.setup(self)
          end,
          tokens = function(self, data)
            return openai.handlers.tokens(self, data)
          end,
          form_parameters = function(self, params, messages)
            return openai.handlers.form_parameters(self, params, messages)
          end,
          form_messages = function(self, messages)
            return openai.handlers.form_messages(self, messages)
          end,
          form_tools = function(self, tools)
            return openai.handlers.form_tools(self, tools)
          end,
          chat_output = function(self, data)
            return openai.handlers.chat_output(self, data)
          end,
          inline_output = function(self, data, context)
            return openai.handlers.inline_output(self, data, context)
          end,
          tools = {
            format_tool_calls = function(self, tools)
              return openai.handlers.tools.format_tool_calls(self, tools)
            end,
            output_response = function(self, tool_call, output)
              return openai.handlers.tools.output_response(self, tool_call, output)
            end,
          },
          on_exit = function(self, data)
            return openai.handlers.on_exit(self, data)
          end,
        },
      })
    end,
  },

Interestingly I can't open the debug info using gd:

E5108: Error executing lua: ...Cellar/neovim/0.11.1/share/nvim/runtime/lua/vim/iter.lua:1064: src must be a table or function
stack traceback:
[C]: in function 'error'
...Cellar/neovim/0.11.1/share/nvim/runtime/lua/vim/iter.lua:1064: in function 'iter'
...mpanion.nvim/lua/codecompanion/strategies/chat/debug.lua:137: in function 'rhs'
...y/codecompanion.nvim/lua/codecompanion/utils/keymaps.lua:80: in function <...y/codecompanion.nvim/lua/codecompanion/utils/keymaps.lua:77>

I might just overlook something completely obvious, but any help would be greatly appreciated!

Edit:

Interesting, I was playing around with it a bit more and functionally didn't change anything:

  adapters = {
    azure_openai = function()
      local openai = require("codecompanion.adapters.openai")
      return require("codecompanion.adapters").extend("azure_openai", {
        env = {
          api_key = 'cmd:redacted',
          endpoint = 'cmd:redacted',
          api_version = "2024-12-01-preview",
        },
        roles = {
          llm = "assistant",
          user = "user",
          tool = "tool",
        },
        opts = {
          stream = true,
          tools = true,
        },
        schema = {
          model = {
            default = "gpt-4.1",
          },
        },
        handlers = {
          setup = openai.handlers.setup,
          tokens = openai.handlers.tokens,
          form_parameters = openai.handlers.form_parameters,
          form_messages = openai.handlers.form_messages,
          chat_output = openai.handlers.chat_output,
          inline_output = openai.handlers.inline_output,
          on_exit = openai.handlers.on_exit,
          form_tools = openai.handlers.form_tools,
          tools = {
            format_tool_calls = openai.handlers.tools.format_tool_calls,
            output_response = openai.handlers.tools.output_response,
          },
        },
      })
    end,
  },

It seems to be somewhat picky sometimes, maybe its just a prompting or gpt-4.1 issue?

[olimorris]

It might also be an @editor issue. We have plans to improve it quite significantly in the next month or two. Function calling, if the adapter has an OpenAI compatible endpoint should be a simple case of just pointing to the OpenAI adapter's handlers.