Skip to content

Add Bring Your Own Model Capability #13

@tejugang

Description

@tejugang

Enable users to integrate their own hosted inference models by providing an endpoint, authentication token, and model name. This allows flexibility for teams to choose and manage their own models instead of relying on a fixed one.

Acceptance Criteria:

  • Configuration support for custom model endpoint, token, and model name
  • Documentation on how to connect to external inference services
  • Validation to ensure the provided model endpoint is functional

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions