Inference Gateway

All

22 repositories

ui
Public
The UI for the inference-gateway, providing a user-friendly interface to interact with and visualize inference results and manage models
ui inference-gateway
TypeScript
•
MIT License
•0•2•9•1•Updated Aug 1, 2025Aug 1, 2025
inference-gateway
Public
An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
api kubernetes golang performance opensource proxy gateway proxy-server self-hosted tracing
Go
•
MIT License
•5•45•7•0•Updated Jul 30, 2025Jul 30, 2025
adl-cli
Public
A command-line tool to scaffold and manage production-ready AI Agents powered by the A2A (Agent-to-Agent) protocol
docker ai docker-compose metrics utils production-ready scaffolding agents observability tls-support
Go
•
MIT License
•0•0•1•0•Updated Jul 30, 2025Jul 30, 2025
rust-adk
Public
An Agent Development Kit (ADK) allowing for seamless creation of A2A-compatible agents written in Rust
rust adk a2a inference-gateway a2a-protocol
Rust
•
MIT License
•0•0•0•0•Updated Jul 30, 2025Jul 30, 2025
typescript-adk
Public
An Agent Development Kit (ADK) allowing for seamless creation of A2A-compatible agents written in TypeScript
typescript adk a2a inference-gateway a2a-protocol
0•0•0•0•Updated Jul 30, 2025Jul 30, 2025
adk
Public
An Agent Development Kit (ADK) allowing for seamless creation of A2A-compatible agents written in Go
adk a2a llm inference-gateway a2a-protocol a2a-server
Go
•
MIT License
•0•4•2•0•Updated Jul 29, 2025Jul 29, 2025
operator
Public
This project provides a Kubernetes Operator for managing the lifecycle of the inference-gateway and its related components. It simplifies deployment, configuration, and scaling of the gateway within Kubernetes clusters, enabling seamless integration of inference workflows.
kubernetes operator kubernetes-operator vendor-agnostic llm llm-inference inference-gateway
Go
•
MIT License
•0•1•2•0•Updated Jul 29, 2025Jul 29, 2025
docs
Public
Extensive documentation of the inference-gateway
documentation gateway llms inference-gateway
MDX
•
MIT License
•0•0•0•0•Updated Jul 28, 2025Jul 28, 2025
adl
Public
A declarative language for defining AI agents, their capabilities, and tools. ADL simplifies agent development by generating consistent, production-ready code from a single manifest. Build faster. Deploy smarter. Stay consistent.
ddd sdl domain-driven-design standard adl domain-driven-development
1•4•0•0•Updated Jul 27, 2025Jul 27, 2025
typescript-sdk
Public
An SDK written in Typescript for the Inference Gateway
sdk typescript-sdk inference-gateway
TypeScript
•
MIT License
•0•1•2•1•Updated Jul 26, 2025Jul 26, 2025
python-sdk
Public
An SDK written in Python for the Inference Gateway
sdk sdk-python inference-gateway
Python
•
MIT License
•0•0•0•0•Updated Jul 26, 2025Jul 26, 2025
rust-sdk
Public
An SDK written in Rust for the Inference Gateway
sdk rust-sdk inference-gateway
Rust
•
MIT License
•0•2•0•0•Updated Jul 26, 2025Jul 26, 2025
sdk
Public
An SDK written in Go for the Inference Gateway
sdk sdk-go inference-gateway
Go
•
MIT License
•0•1•0•0•Updated Jul 26, 2025Jul 26, 2025
schemas
Public
This repository contain the different schemas like MCP, A2A, OpenAPI
Dockerfile
•
MIT License
•0•0•0•0•Updated Jul 26, 2025Jul 26, 2025
registry
Public
A registry website for hosting the a2a agents that were built using the Inference Gateway ADK
0•0•0•0•Updated Jul 23, 2025Jul 23, 2025
coder-agent
Public
This agent is a code reviewer agent - it can clone, checkout a branch, review code and update pull requests - could be used with any provider, not just claude or copilot
0•0•0•0•Updated Jul 23, 2025Jul 23, 2025
google-calendar-agent
Public
A2A-compatible agent enabling Google Calendar scheduling, retrieval, and automation
go golang google calendar google-calendar google-calendar-api a2a inference-gateway a2a-protocol
Go
•
MIT License
•0•2•0•0•Updated Jul 21, 2025Jul 21, 2025
awesome-a2a
Public
A curated list of A2A-compatible agents that are tested and fully operational
awesome awesome-list a2a
Dockerfile
•
MIT License
•0•1•0•0•Updated Jun 20, 2025Jun 20, 2025
a2a-debugger
Public
The ultimate A2A agents troubleshooter
debugger utils a2a agentic-ai
Go
•
MIT License
•0•1•0•0•Updated Jun 19, 2025Jun 19, 2025
tools
Public
A repository for hosting the tools shared between different projects - like codegen for example
Go
•
MIT License
•0•0•0•0•Updated Jun 12, 2025Jun 12, 2025
coder-playground
Public
A repository for coder playground, testing etc
Rust
•0•0•1•0•Updated Feb 15, 2025Feb 15, 2025
nocode
Public
The best way to write secure and reliable applications. Write nothing; deploy nowhere.
Dockerfile
•
Apache License 2.0
•4.8k•0•0•0•Updated Aug 7, 2024Aug 7, 2024