Skip to content

[Bug]: LiteLLM Proxy deployment to GCP Cloud Run failing when attempting to use GCS for config.yaml #14648

@ElliotK-IB

Description

@ElliotK-IB

What happened?

Hi, I'm trying to deploy LiteLLM Proxy to GCP Cloud Run with the config.yaml set up in Google Cloud Storage (GCS) according to this documentation: 5. config.yaml file on s3, GCS Bucket Object/url.

Version: v1.76.1-stable (i.e., main-stable as of 9/16/2025)

I'm getting this error message:

LiteLLM Proxy:ERROR�[0m: load_config_utils.py:63 - Error retrieving file contents: GCS Bucket logging is a premium feature. Please upgrade to use it. You must be a LiteLLM Enterprise user to use this feature. If you have a license please set `LITELLM_LICENSE` in your env. Get a 7 day trial key here: https://www.litellm.ai/enterprise#trial.

Not sure if GCS Bucket logging and fetching the config from GCS are meant to be related. Is fetching the config from GCS a premium feature as well?

If not, any pointers on how to get this working?

I'm using a cloudbuild.yaml file, here's the relevant snippet where I'm setting the environment variables:

entrypoint: gcloud
    args:
      - 'run'
      - 'deploy'
      - '${_SERVICE_NAME}'
      - '--image'
      - '${_GCP_REGION}-docker.pkg.dev/${PROJECT_ID}/${_ARTIFACT_REGISTRY_REPO}/${_SERVICE_NAME}:${COMMIT_SHA}'
      - '--region'
      - '${_GCP_REGION}'
      - '--allow-unauthenticated'
      - '--port'
      - '4000'
      - '--set-env-vars=LITELLM_CONFIG_BUCKET_TYPE=gcs,LITELLM_CONFIG_BUCKET_NAME=${_GCS_BUCKET_NAME},LITELLM_CONFIG_BUCKET_OBJECT_KEY=${_GCS_OBJECT_KEY}'
      - '--update-secrets=GCP_PROJECT_ID=${_GCP_PROJECT_ID_SECRET}:latest,GCP_PROJECT_REGION=${_GCP_PROJECT_REGION_SECRET}:latest'
...
substitutions:
  ...
  _GCS_BUCKET_NAME: 'my_bucket_name'
  _GCS_OBJECT_KEY: 'config.yaml'
  ...

The service account has Storage Object Admin role.

Additional

  • I was able to get LiteLLM Proxy running fine with config in the repo but am considering GCS for greater flexibility.
  • I don't have a database or proxy master key set up yet, but those are next so I can get the Admin UI going

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.76.1-stable

Twitter / LinkedIn details

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions