Skip to content

v0.5.5 - Improved cache, batch processing, health endpoint

Latest
Compare
Choose a tag to compare
@deadbits deadbits released this 23 Aug 18:41
· 2 commits to main since this release

Added

  • Improved cache by implementing LRU with a max cache size
  • Batch processing of multiple texts to embed with single request
  • /health endpoint to return server status information