[WinError 10061] No connection could be made because the target machine actively refused it

[adamkwhite]

When I start the service I get following output:

(privategpt) PS C:\Code\AI> poetry run python -m private_gpt

- 21:54:36.798 [INFO    ] private_gpt.components.llm.llm_component - Initializing the LLM in mode=ollama

21:54:37.851 [INFO    ] private_gpt.components.embedding.embedding_component - Initializing the embedding model in mode=huggingface
21:54:38.393 [INFO    ] llama_index.core.indices.loading - Loading all indices.
21:54:38.641 [INFO    ]         private_gpt.ui.ui - Mounting the gradio UI, at path=/
21:54:38.742 [INFO    ]             uvicorn.error - Started server process [10008]
21:54:38.742 [INFO    ]             uvicorn.error - Waiting for application startup.
21:54:38.743 [INFO    ]             uvicorn.error - Application startup complete.
21:54:38.743 [INFO    ]             uvicorn.error - Uvicorn running on http://0.0.0.0:8001 (Press CTRL+C to quit)

When I load the UI, I choose "LLM Chat (no context from files)". The operations returns the following

21:55:13.332 [INFO    ]            uvicorn.access - 127.0.0.1:60152 - "GET /queue/data?session_hash=4d9ckuf9j0m HTTP/1.1" 200
21:55:17.790 [WARNING ] llama_index.core.chat_engine.types - Encountered exception writing response to history: [WinError 10061] No connection could be made because the target machine actively refused it

Other items of note

• I am running privateGPT via an Anaconda administrator shell
• I have turned off Windows Firewall, Disabled NordVPN scanning services.
• Did some research - it seems like this has to do with binding. Can't figure out where

[adamkwhite]

After reading through some troubles others have had I realized I didn't have ollama running. I executed "ollama -serve" and now I'm getting 404 errors

3:45:22.890 [WARNING ] llama_index.core.chat_engine.types - Encountered exception writing response to history: Client error '404 Not Found' for url 'http://localhost:11434/api/chat'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404

From the Ollama Console where ollama is running I'm seeing 404 errors

`{"function":"print_timings","level":"INFO","line":287,"msg":"          total time =   41054.20 ms","slot_id":0,"t_prompt_processing":3282.444,"t_token_generation":37771.754,"t_total":41054.198000000004,"task_id":0,"tid":"5252","timestamp":1711338171}
{"function":"update_slots","level":"INFO","line":1660,"msg":"slot released","n_cache_tokens":86,"n_ctx":2048,"n_past":85,"n_system_tokens":0,"slot_id":0,"task_id":0,"tid":"5252","timestamp":1711338171,"truncated":false}
[GIN] 2024/03/24 - 23:42:51 | 200 |   41.0568166s |       127.0.0.1 | POST     "/api/chat"
[GIN] 2024/03/24 - 23:43:04 | 404 |            0s |       127.0.0.1 | GET      "/api/chat"
[GIN] 2024/03/24 - 23:44:01 | 404 |       574.1µs |       127.0.0.1 | POST     "/api/chat"
[GIN] 2024/03/24 - 23:44:06 | 404 |       529.4µs |       127.0.0.1 | POST     "/api/chat"
[GIN] 2024/03/24 - 23:44:16 | 404 |       567.6µs |       127.0.0.1 | POST     "/api/chat"
[GIN] 2024/03/24 - 23:45:22 | 404 |       576.4µs |       127.0.0.1 | POST     "/api/chat"`