Skip to content

Without docker and separate machines for front end and backend #1618

Answered by gl2007
gl2007 asked this question in Q&A
Discussion options

You must be logged in to vote

Got it working if anyone is interested. Here is my setup:
Laptop:
Windows and VS code
Frontend, backend & worker

Workstation (with optional GPU):
Windows
Ollama (various LLM options)
Memurai - Redis does not directly work in Windows, tried via WSL, big hassle to connect from host/or my laptop using intranet IP. ChatGPT suggested Memurai Redis alternative for Windows, so far working well
MongoDB

Here is my working .env:

API_URL=http://127.0.0.1:7091
API_KEY=OLLAMA_NO_KEY
#LLM choices are: openai,azure_openai,sagemaker,huggingface,llama.cpp,anthropic,docsgpt,premai,groq,google
LLM_NAME=openai
#LLM_NAME=docsgpt
#below is used if LLM is hosted by "backend"
#MODEL_NAME=svk/docsgpt-7b
MODEL_NAM…

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by gl2007
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant