Inference Gateway

All

13 repositories

inference-gateway
Public
An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
api kubernetes golang performance opensource proxy gateway proxy-server self-hosted tracing
Go
•
MIT License
•1•33•8•1•Updated Jun 10, 2025Jun 10, 2025
tools
Public
A repository for hosting the tools shared between different projects - like codegen for example
Go
•0•0•0•0•Updated Jun 10, 2025Jun 10, 2025
schemas
Public
This repository contain the different schemas like MCP, A2A, OpenAPI
Dockerfile
•0•0•0•0•Updated Jun 9, 2025Jun 9, 2025
docs
Public
Extensive documentation of the inference-gateway
documentation gateway llms inference-gateway
MDX
•
MIT License
•0•0•0•0•Updated Jun 8, 2025Jun 8, 2025
google-calendar-agent
Public
A2A-compatible agent enabling Google Calendar scheduling, retrieval, and automation
go golang google calendar google-calendar google-calendar-api a2a inference-gateway a2a-protocol
Go
•
MIT License
•0•1•2•0•Updated Jun 8, 2025Jun 8, 2025
rust-sdk
Public
An SDK written in Rust for the Inference Gateway
sdk rust-sdk inference-gateway
Rust
•
MIT License
•0•2•0•1•Updated Jun 8, 2025Jun 8, 2025
awesome-a2a
Public
A curated list of A2A-compatible agents that are tested and fully operational
0•0•0•0•Updated Jun 7, 2025Jun 7, 2025
ui
Public
The UI for the inference-gateway, providing a user-friendly interface to interact with and visualize inference results and manage models
ui inference-gateway
TypeScript
•
MIT License
•0•2•7•0•Updated Jun 2, 2025Jun 2, 2025
typescript-sdk
Public
An SDK written in Typescript for the Inference Gateway
sdk typescript-sdk inference-gateway
TypeScript
•
MIT License
•0•0•1•0•Updated Jun 2, 2025Jun 2, 2025
python-sdk
Public
An SDK written in Python for the Inference Gateway
sdk sdk-python inference-gateway
Python
•
MIT License
•0•0•0•0•Updated May 27, 2025May 27, 2025
sdk
Public
An SDK written in Go for the Inference Gateway
sdk sdk-go inference-gateway
Go
•
MIT License
•0•0•0•0•Updated May 26, 2025May 26, 2025
operator
Public
This project provides a Kubernetes Operator for managing the lifecycle of the inference-gateway and its related components. It simplifies deployment, configuration, and scaling of the gateway within Kubernetes clusters, enabling seamless integration of machine learning inference workflows.
Go
•
MIT License
•0•0•0•0•Updated May 2, 2025May 2, 2025
coder-playground
Public
A repository for coder playground, testing etc
Rust
•0•0•1•0•Updated Feb 15, 2025Feb 15, 2025