systemoutprintlnnnn / LLM-Cache Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

基于Golang的高性能LLM语义缓存，能够大幅度减少LLM API开销，特别是在RAG-based 知识库系统当中

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
LICENSE		LICENSE
README.md		README.md

Repository files navigation

LLM-Cache

基于Golang的高性能LLM语义缓存，能够大幅度减少LLM API开销，特别是在RAG-based 知识库系统当中

About

基于Golang的高性能LLM语义缓存，能够大幅度减少LLM API开销，特别是在RAG-based 知识库系统当中

Report repository

Releases

No releases published

Packages

No packages published