Integrate Vector Database into Llamafile #358
JohnnyOpcode
started this conversation in
Ideas
Replies: 1 comment
-
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I see Nvidia has come up with something like Llamafile with their NIM format. Innovation spurs innovation which is a wonderful thing.
Now I'm wondering if it would be possible to fuse a vector database into a Llamafile. The ability to have a self-contained LLM with a vector dataset really expands on the deployment scenarios. Thoughts?
Beta Was this translation helpful? Give feedback.
All reactions