Skip to content

Commit 4d6218f

Browse files
authored
Merge pull request #39054 from github/repo-sync
Repo sync
2 parents f6cb8df + c7486cf commit 4d6218f

File tree

5 files changed

+13
-9
lines changed

5 files changed

+13
-9
lines changed

content/billing/managing-billing-for-your-products/about-billing-for-github-models.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ For accounts that use a custom model with a third-party model provider, billing
5959

6060
## Opting in to paid usage
6161

62-
> [!NOTE] Once you opt in to paid usage, you will have access to production grade rate limits and be billed for all usage thereafter. For more information about these rate limits, see [Azure AI Foundry Models quotas and limits](https://learn.microsoft.com/en-us/azure/ai-foundry/model-inference/quotas-limits) in the Azure documentation.
62+
{% data reusables.github-models.production-rate-limits-note %}
6363

6464
Enterprises and organizations can opt in to paid usage to access expanded model capabilities, including increased request allowances and larger context windows. You can manage their spending by setting a budget.
6565

content/github-models/use-github-models/prototyping-with-ai-models.md

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -73,7 +73,7 @@ The steps to use each model are similar. In general, you will need to:
7373
1. Optionally, use the language dropdown to select the programming language.
7474
1. Optionally, use the SDK dropdown to select which SDK to use.
7575

76-
All models can be used with the Azure AI Inference SDK, and some models support additional SDKs. If you want to easily switch between models, you should select "Azure AI Inference SDK". If you selected "REST" as the language, you won't use an SDK. Instead, you will use the API endpoint directly. {% ifversion fpt %} See [{% data variables.product.prodname_github_models %} REST API](/rest/models?apiVersion=2022-11-28). {% endif %}
76+
All models can be used with the Azure AI Inference SDK, and some models support additional SDKs. If you want to easily switch between models, you should select "Azure AI Inference SDK." If you selected "REST" as the language, you won't use an SDK. Instead, you will use the API endpoint directly. {% ifversion fpt %} See [{% data variables.product.prodname_github_models %} REST API](/rest/models?apiVersion=2022-11-28). {% endif %}
7777
1. Either open a codespace, or set up your local environment:
7878
* To run in a codespace, click **{% octicon "codespaces" aria-hidden="true" aria-label="codespaces" %} Run codespace**, then click **Create new codespace**.
7979
* To run locally:
@@ -131,16 +131,20 @@ If you prefer to experiment with AI models in your IDE, you can install the AI T
131131

132132
## Going to production
133133

134-
The rate limits for the playground and free API usage are intended to help you experiment with models and develop your AI application. Once you are ready to bring your application to production, you can use a token from a paid Azure account instead of your {% data variables.product.company_short %} {% data variables.product.pat_generic %}. You don't need to change anything else in your code.
135-
136-
For more information, see the [Azure AI](https://aka.ms/azureai/github-models) documentation.
134+
The free rate limits provided in the playground and API usage are intended to help you get started with experimentation. When you are ready to move beyond the free offering, you have two options for accessing AI models beyond the free limits:
135+
* You can opt in to paid usage for {% data variables.product.prodname_github_models %}, allowing your organization to access increased rate limits, larger context windows, and additional features. See [AUTOTITLE](/billing/managing-billing-for-your-products/about-billing-for-github-models).
136+
* If you have an existing OpenAI or Azure subscription, you can bring your own API keys (BYOK) to access custom models. Billing and usage are managed directly through your provider account, such as your Azure Subscription ID. See [AUTOTITLE](/github-models/github-models-at-scale/set-up-custom-model-integration-models-byok).
137137

138138
## Rate limits
139139

140+
{% data reusables.github-models.production-rate-limits-note %}
141+
140142
The playground and free API usage are rate limited by requests per minute, requests per day, tokens per request, and concurrent requests. If you get rate limited, you will need to wait for the rate limit that you hit to reset before you can make more requests.
141143

142144
Low, high, and embedding models have different rate limits. To see which type of model you are using, refer to the model's information in {% data variables.product.prodname_marketplace %}.
143145

146+
For custom models accessed with your own API keys, rate limits are set and enforced by your model provider.
147+
144148
<table>
145149
<tr>
146150
<th scope="col" style="width:15%"><b>Rate limit tier</b></th>
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
> [!NOTE] Once you opt in to paid usage, you will have access to production grade rate limits and be billed for all usage thereafter. For more information about these rate limits, see [Azure AI Foundry Models quotas and limits](https://learn.microsoft.com/en-us/azure/ai-foundry/model-inference/quotas-limits) in the Azure documentation.

data/reusables/organizations/additional-permissions.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -65,5 +65,4 @@ For more information, see [AUTOTITLE](/discussions).
6565
* Manage runners
6666
* Manage secrets
6767
* Manage variables
68-
* Manage environments (including environment secrets and variables)
69-
68+
* Manage environments (including environment secrets and variables)

src/events/components/experiments/experiments.ts

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,10 +21,10 @@ export const EXPERIMENTS = {
2121
ai_search_experiment: {
2222
key: 'ai_search_experiment',
2323
isActive: true, // Set to false when the experiment is over
24-
percentOfUsersToGetExperiment: 30, // 30% of users will get the experiment
24+
percentOfUsersToGetExperiment: 0, // 30% of users will get the experiment
2525
includeVariationInContext: true, // All events will include the `experiment_variation` of the `ai_search_experiment`
2626
limitToLanguages: ['en'], // Only users with the `en` language will be included in the experiment
27-
alwaysShowForStaff: true, // When set to true, staff will always see the experiment (determined by the `staffonly` cookie)
27+
alwaysShowForStaff: false, // When set to true, staff will always see the experiment (determined by the `staffonly` cookie)
2828
turnOnWithURLParam: 'ai_search', /// When the query param `?feature=ai_search` is set, the experiment will be enabled
2929
},
3030
/* Add new experiments here, example:

0 commit comments

Comments
 (0)