Skip to content
Change the repository type filter

All

    Repositories list

    • Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
      Rust
      49000Updated Jun 13, 2025Jun 13, 2025
    • Fast serverless LLM inference, in Rust.
      Rust
      20000Updated Mar 1, 2025Mar 1, 2025
    • Rust
      0000Updated Oct 17, 2024Oct 17, 2024