Cannot change the OLLAMA_API_BASE_URL

[TheArKaID]

I might fails to understand, but how to make the cpu/astra-assistant-api to connect to ollama:11434 instead of localhost:11434?

In a glance, I'm looking for a drop-in replacement of the OpenAI Assistant, find astra-assistant-api. I wanna to use a model from Ollama, but fail in this step.

[phact]

OLLAMA_API_BASE_URL is the right env var.

Are you using patch() to create your client? If so, it should pick up the env var here

astra-assistants-api/client/astra_assistants/patch.py

Line 489 in d070f2f

headers["base_url"]= os.getenv("OLLAMA_API_BASE_URL")

[phact]

Exactly. Yeah u could probably whip up your own php patch for your client. Is it this?
https://github.com/openai-php/client

[TheArKaID]

Yes, I use that

[TheArKaID]

I already changed the environment, and running the example. But the API still calling the localhost:11434 instead of ollama:11434

Any other clue?

[phact]

headers["base_url"]= os.getenv("OLLAMA_API_BASE_URL")

Set the base_url header in your request!

[TheArKaID]

That should in the running datastax/astra-assistants image, shouldn't? Also, I use the node example, is it not configuring properly? I already trying either basic.mjs and basic-with-patch.mjs

And, still cannot make it works. The log already shown base_url set to ollama:11434, but the response from runnning docker container is trying to fetch from localhost:11434.