Enable Token-Based Authentication for LLMs Using custom IDP

[gunsto]

Feature request

Description

I would like to propose the addition of a feature in CodeGPT to enable token-based authentication for accessing Large Language Models (LLMs), specifically for my use case with Azure OpenAI. This feature would enhance security and streamline the authentication process by integrating with an Identity Provider (IDP), such as Azure Active Directory (Azure AD) or Entra ID.

Current Functionality

Currently, CodeGPT allows users to insert a URL and Personal Access Token (PAT) to access REST APIs for LLMs. While this method works, it lacks the flexibility and security provided by token-based authentication via an IDP.

Proposed Enhancement

I propose adding a new authentication option within the selection menu. This option would allow users to authenticate using an IDP such as Azure AD/Entra ID and obtain an access token to use for API requests. The feature could include the following components:

Login Button for IDP Authentication

• Add a "Login / SSO" button alongside the existing URL and PAT fields.
• When clicked, this button should initiate the OAuth2 authentication flow with the IDP.

OAuth2 Authentication Flow

• Redirect users to the OIDC IDP login page to authenticate.
• After successful authentication, the IDP should issue an access token.

Access Token Usage

• Automatically use the obtained access token to authenticate API requests to LLMs (e.g., Azure OpenAI).
• Ensure the token is securely stored and refreshed as needed.

Configuration Options

• Allow users to configure IDP/AAD settings, such as Client ID, Tenant ID, and Scopes, within CodeGPT.

Benefits

• Enhanced Security: Token-based authentication via IDP/AAD provides a more secure and scalable way to manage API access.
• User Convenience: Simplifies the authentication process by leveraging existing Azure AD credentials.
• Flexibility: Supports enterprise environments where Azure AD is the standard for identity management.

Conclusion

Implementing token-based authentication for LLMs using IDP/AAD in CodeGPT will significantly improve security and user experience. I believe this feature will be highly beneficial for corporate users who rely on Azure OpenAI and seek a seamless and secure authentication process.

I look forward to hearing your thoughts and feedback on this idea. Thank you for considering this discussion topic.