|
| 1 | +--- |
| 2 | +title: Overview |
| 3 | +description: Introduction to AI Server and its key features |
| 4 | +--- |
| 5 | + |
| 6 | +# Overview |
| 7 | + |
| 8 | +AI Server is an independent microservice designed to provide a comprehensive suite of AI features for your applications. It serves as a private gateway to process LLM, AI, and image transformation requests, dynamically delegating tasks across multiple providers including Ollama, OpenRouter, Replicate, Comfy UI, Whisper, and ffmpeg. |
| 9 | + |
| 10 | + |
| 11 | +## Key Features |
| 12 | + |
| 13 | +- **Unified AI Gateway**: Centralize all your AI requests through a single self-hosted service. |
| 14 | +- **Multi-Provider Support**: Seamlessly integrate with Ollama, Open AI, Comfy UI, and more. |
| 15 | +- **Type-Safe Integrations**: Native end-to-end typed integrations for popular languages including C#, TypeScript, Python, and more. |
| 16 | +- **Secure Access**: API key authentication to protect your AI resources. |
| 17 | +- **Managed File Storage**: Built-in CDN-hostable storage for AI-generated assets. |
| 18 | +- **Background Job Processing**: Efficient handling of long-running AI tasks. |
| 19 | +- **Custom Deployment**: Run as a single Docker container, with optional GPU-equipped agents for advanced tasks. |
| 20 | + |
| 21 | +## Why Use AI Server? |
| 22 | + |
| 23 | +AI Server simplifies the integration and management of AI capabilities in your applications: |
| 24 | + |
| 25 | +1. **Centralized Management**: Manage all your AI providers and requests from a single interface. |
| 26 | +2. **Cost Control**: Monitor and control usage across your organization with detailed request history. |
| 27 | +3. **Flexibility**: Easy to scale and adapt as your AI needs evolve. |
| 28 | +4. **Security**: Keep your AI operations behind your firewall with a private, managed gateway. |
| 29 | +5. **Developer-Friendly**: Type-safe APIs and integrations for a smooth development experience. |
| 30 | + |
| 31 | +## Supported AI Capabilities |
| 32 | + |
| 33 | +- **Large Language Models**: Integrate with Open AI Chat, Ollama, and various API gateways. |
| 34 | +- **Image Generation and Manipulation**: Leverage Comfy UI for text-to-image, image-to-image, and more. |
| 35 | +- **Audio Processing**: Text-to-speech, speech-to-text, and audio manipulations. |
| 36 | +- **Video Processing**: Format conversions, scaling, cropping, and more with ffmpeg integration. |
| 37 | + |
| 38 | +## Getting Started for Developers |
| 39 | + |
| 40 | +1. **Setup**: Follow the Quick Start guide to deploy AI Server. |
| 41 | +2. **Configuration**: Use the Admin UI to add your AI providers and generate API keys. |
| 42 | +3. **Integration**: Choose your preferred language and use ServiceStack's Add ServiceStack Reference to generate type-safe client libraries. |
| 43 | +4. **Development**: Start making API calls to AI Server from your application, leveraging the full suite of AI capabilities. |
| 44 | + |
| 45 | +## Learn More |
| 46 | + |
| 47 | +- Website: [openai.servicestack.net](https://openai.servicestack.net) |
| 48 | +- GitHub: [github.com/ServiceStack/ai-server](https://github.com/ServiceStack/ai-server) |
| 49 | + |
| 50 | +AI Server is actively developed and continuously expanding its capabilities. Stay tuned for updates and new features as we work towards our first V1 release. |
0 commit comments