Skip to content

Commit 280ec73

Browse files
committed
Add llama-server docs
1 parent d45056e commit 280ec73

File tree

6 files changed

+465
-9
lines changed

6 files changed

+465
-9
lines changed

MyApp/_pages/ai-server/chat.md

-5
Original file line numberDiff line numberDiff line change
@@ -83,8 +83,3 @@ This means you can switch to using typed APIs in your preferred language with yo
8383
::include ai-server/cs/open-ai-requests-1.cs.md::
8484

8585
This shows usage of the `OpenAiChat` request DTO directly with OpenAI's API using the ServiceStack `JsonApiClient`, so you get the benefits of using typed APIs in your preferred language with your existing service providers OpenAI compatible APIs.
86-
87-
88-
89-
90-

MyApp/_pages/ai-server/configuration.md

+21-4
Original file line numberDiff line numberDiff line change
@@ -84,13 +84,30 @@ Media Providers can also be configured in the Admin Portal. These include:
8484
- **Image Generation**
8585
- **Text-to-Speech**
8686

87-
## Generating AI Server API Keys
87+
## Register AI Providers
8888

89-
API keys are used to authenticate requests to AI Server and are generated via the Admin Portal.
89+
To let AI Server know about your API Providers or self-hosted instances by creating them in the **AI Provider** section where you can use **Custom** AI Provider type to register any OpenAI Chat compatible endpoint, e.g:
9090

91-
Here you can create new API keys, view existing keys, and revoke keys as needed.
91+
[![](/img/pages/ai-server/custom-openai-provider.webp)](/ai-server/)
9292

93-
Keys can be created with expiration dates, and restrictions to specific API endpoints, along with notes to help identify the key's purpose.
93+
After registering AI Providers you can try to use them in the [Chat UI](/ai-server/chat):
94+
95+
[![](/img/pages/ai-server/custom-openai-provider-chat.webp)](/ai-server/chat)
96+
97+
## Create API Keys for your Apps
98+
99+
After testing the llama-server instance is working with the Chat UI it's time to create API Keys
100+
for all your Apps so they can access AI Servers APIs with the [API Keys UI](/auth/admin-apikeys#api-keys-admin-ui):
101+
102+
![](/img/pages/ai-server/admin-apikeys.webp)
103+
104+
Here you can create new API keys, view existing keys, and revoke keys as needed. Keys can be created with expiration dates,
105+
and restrictions to specific API endpoints, along with notes to help identify the key's purpose.
106+
107+
It's recommended to use a different API Key per App so they can be monitored and analyzed separately.
108+
109+
With a valid API Key in hand your App's can use AI Server's DTOs with ServiceStack generic
110+
service clients to enable typed integrations in [11 different languages](/ai-server/openai-chat-all-languages).
94111

95112
## Stored File Management
96113

0 commit comments

Comments
 (0)