ort is an (unofficial) ONNX Runtime 1.21 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference and training on both CPU & GPU.
Open a PR to add your project here 🌟
- Bloop uses
ortto power their semantic code search feature. - edge-transformers uses
ortfor accelerated transformer model inference at the edge. - Ortex uses
ortfor safe ONNX Runtime bindings in Elixir. - Supabase uses
ortto remove cold starts for their edge functions. - Lantern uses
ortto provide embedding model inference inside Postgres. - Magika uses
ortfor content type detection. sbv2-apiis a fast implementation of Style-BERT-VITS2 text-to-speech usingort.- Ahnlich uses
ortto power their AI proxy for semantic search applications. - Spacedrive is a cross-platform file manager with AI features powered by
ort. - BoquilaHUB uses
ortfor local AI deployment in biodiversity conservation efforts.
