InftyAI

All

11 repositories

scheduler-plugins
Public
Scheduler plugins designed for smart scheduling with llmaz.
Go
•
Apache License 2.0
•2•8•1•1•Updated May 29, 2025May 29, 2025
llmaz
Public
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
kubernetes inference huggingface llm modelscope llamacpp vllm text-generation-inference ollama sglang
Go
•
Apache License 2.0
•29•178•39•4•Updated May 26, 2025May 26, 2025
Awesome-LLMOps
Public
🎉 An awesome & curated list of best LLMOps tools.
awesome ai awesome-list llm llmops ai-developer-tools
Python
•
Apache License 2.0
•23•108•2•1•Updated May 26, 2025May 26, 2025
website
Public
Website and Blogs.
blog website
HTML
•
MIT License
•1•1•4•0•Updated May 14, 2025May 14, 2025
community
Public
The InftyAI community.
Apache License 2.0
•1•0•0•0•Updated Apr 18, 2025Apr 18, 2025
template-repo
Public template
A template repo.
Apache License 2.0
•1•0•0•0•Updated Mar 15, 2025Mar 15, 2025
.github
Public
Apache License 2.0
•1•0•0•0•Updated Feb 15, 2025Feb 15, 2025
Manta
Public
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
kubernetes distributed-systems cache p2p-network llm
Go
•
Apache License 2.0
•3•23•14•1•Updated Dec 6, 2024Dec 6, 2024
omnistore
Public
🎯 An unified python client to communicate with various kinds of object-store providers.
python oss s3 gcs minio object-store
Python
•
MIT License
•2•2•4•0•Updated Nov 11, 2024Nov 11, 2024
llmlite
Public
🌵 A library helps to communicate with all kinds of LLMs consistently.
llmops
Python
•
MIT License
•3•18•18•0•Updated Jul 5, 2024Jul 5, 2024
PR-Copilot
Public
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛
Python
•
MIT License
•3•3•2•0•Updated Jun 29, 2024Jun 29, 2024