Support discovering gemini, anthropic, xai models by calling their /v1/model endpoint

[krrishdholakia]

Title

Enables SDK user to check what all models a key can call

from litellm import get_valid_models

valid_models = get_valid_models(
    check_provider_endpoint=True, custom_llm_provider="gemini"
)
assert len(valid_models) > 0

print(valid_models) # ["gemini/gemini-1.5-flash", ..]

Relevant issues

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

• I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
• I have added a screenshot of my new test passing locally
• My PR passes all unit tests on (make test-unit)[https://docs.litellm.ai/docs/extras/contributing_code]
• My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🆕 New Feature
🐛 Bug Fix
🧹 Refactoring
📖 Documentation
🚄 Infrastructure
✅ Test

Changes

• fix: initial commit for adding provider model discovery to gemini

• feat(gemini/): add model discovery for gemini/ route

• docs(set_keys.md): update docs to show you can check available gemini models as well

• feat(anthropic/): add model discovery for anthropic api key

• feat(xai/): add model discovery for XAI

enables checking what models an xai key can call

• ci: bump ci config yml

• fix(topaz/common_utils.py): fix linting error

• fix: fix linting error for python38

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Mar 28, 2025 5:51am