I want to integrate a LiteLLM into Keep and access the latter by Istio VirtualService #4616
Cyberphysics
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I want to install Keep keep-0.1.83 by helm chart in local k8s cluster.
And there are not nginx ingress but a istio ingress in the cluster, so I create a virtualservice of istio in namespace keep which only match / and destination is keep-frontend 3000 port, I access 'keep.example.work' and click main entries list, that's ok, and then I add one Prometheus instance in data source page and saved, one night passed, I access Keep page and found no alerts, it may be normal.
Then I want to integrate a LiteLLM into Keep.
I have access LiteLLM by port-forward the svc and see the Ollama LLM deepseek/deepseek-r1:70b is online.
Then I view the http://keep.example.work/ and found it wrong after some seconds and raise error like:
It looks like websocket svc has been routed bad, so I applyed istio virtualservice yaml file below for routing different types of requests separately; I try modify some rewrite configuration in Istio VirtualService, remove the prefix which include / in tail, it works!
So I maybe contribute my way of making it work!
Beta Was this translation helpful? Give feedback.
All reactions