Issue with PrivateGPT Docker Setup – Ollama CPU Container Shuts Down Immediately

[pooya-bh]

Hey everyone,

I'm trying to set up PrivateGPT using the Default/Ollama CPU setup with Docker as per the [PrivateGPT Quickstart Docs](https://privategpt.dev). The installation completed successfully, and I see three containers running inside the private-gpt container:

• private-gpt-private-gpt-ollama-1
• private-gpt-ollama-cpu-1
• private-gpt-ollama-1

However, when I click the Start button, all the containers start except private-gpt-private-gpt-ollama-1. It starts for a moment and then immediately shuts down.

The error log shows:

2025-03-14 11:38:52 private-gpt-ollama-1 | 10:38:52.849 [INFO    ] httpx - HTTP Request: GET http://ollama:11434/api/tags "HTTP/1.1 403 Forbidden"
2025-03-14 11:38:52 private-gpt-ollama-1 | 10:38:52.850 [ERROR   ] private_gpt.utils.ollama - Failed to connect to Ollama

This is followed by a long traceback of KeyError exceptions related to private_gpt.components.llm.llm_component.LLMComponent, PrivateGptUi, and IngestService.

It seems like private-gpt-private-gpt-ollama-1 is unable to connect to Ollama.
Has anyone encountered this before? Any ideas on how to fix it? Would appreciate any help!