Vertex AI Support

[jermainemercado]

Is it possible to use Vertex AI via ADC?

[coffeegrind123]

hi, please test

https://github.com/coffeegrind123/gemini-code/tree/vertex_ai_support

[coffeegrind123]

also please report if everything works as intended, as i dont use these features

[Luluno01]

I'm using API key from Vertex AI Studio (because I don't have one from Google AI Studio) which is bound to a GCP-managed service account. At the same time, I also created a separate service account with Vertex AI User role and passed the key via .env. However, I got the following error:

Unexpected streaming error (attempt 10/10): litellm.ServiceUnavailableError: litellm.MidStreamFallbackError: litellm.AuthenticationError: VertexAIException - b'{\n  "error": {\n    "code": 401,\n    "message": "API keys are not supported by this API. Expected OAuth2 access token or other authentication credentials that assert a principal. See https://cloud.google.com/docs/authentication",\n    "status": "UNAUTHENTICATED",\n    "details": [\n      {\n        "@type": "type.googleapis.com/google.rpc.ErrorInfo",\n        "reason": "CREDENTIALS_MISSING",\n        "domain": "googleapis.com",\n        "metadata": {\n          "service": "generativelanguage.googleapis.com",\n          "method": "google.ai.generativelanguage.v1beta.GenerativeService.StreamGenerateContent"\n        }\n      }\n    ]\n  }\n}\n' Original exception: AuthenticationError: litellm.AuthenticationError: VertexAIException - b'{\n  "error": {\n    "code": 401,\n    "message": "API keys are not supported by this API. Expected OAuth2 access token or other authentication credentials that assert a principal. See https://cloud.google.com/docs/authentication",\n    "status": "UNAUTHENTICATED",\n    "details": [\n      {\n        "@type": "type.googleapis.com/google.rpc.ErrorInfo",\n        "reason": "CREDENTIALS_MISSING",\n        "domain": "googleapis.com",\n        "metadata": {\n          "service": "generativelanguage.googleapis.com",\n          "method": "google.ai.generativelanguage.v1beta.GenerativeService.StreamGenerateContent"\n        }\n      }\n    ]\n  }\n}\n'

It looks like it calls APIs for Google AI Studio anyway which requires a different API key. Could we send all requests to Vertex AI?