-
-
Notifications
You must be signed in to change notification settings - Fork 4.1k
Open
Labels
Description
What happened?
Getting "invalid JSON payload received" when sending a message to Gemini Flash Image 2.5. Works fine with v1.76.1-nightly
Relevant log output
Error fetching response:Error: 503 data: {"error": {"message": "litellm.ServiceUnavailableError: litellm.MidStreamFallbackError: litellm.BadRequestError: VertexAIException BadRequestError - b'{\n "error": {\n "code": 400,\n "message": "Invalid JSON payload received. Unknown name \\"labels\\": Cannot find field.",\n "status": "INVALID_ARGUMENT",\n "details": [\n {\n "@type": "type.googleapis.com/google.rpc.BadRequest",\n "fieldViolations": [\n {\n "description": "Invalid JSON payload received. Unknown name \\"labels\\": Cannot find field."\n }\n ]\n }\n ]\n }\n}\n'No fallback model group found for original model_group=eit_gemini25flashimage. Fallbacks=[{'imagen-4.0-generate-001': ['imagen-4.0-fast-generate-001', 'eit_imagen3']}]. Received Model Group=eit_gemini25flashimage\nAvailable Model Group Fallbacks=None\nError doing the fallback: litellm.ServiceUnavailableError: litellm.MidStreamFallbackError: litellm.BadRequestError: VertexAIException BadRequestError - b'{\n "error": {\n "code": 400,\n "message": "Invalid JSON payload received. Unknown name \\"labels\\": Cannot find field.",\n "status": "INVALID_ARGUMENT",\n "details": [\n {\n "@type": "type.googleapis.com/google.rpc.BadRequest",\n "fieldViolations": [\n {\n "description": "Invalid JSON payload received. Unknown name \\"labels\\": Cannot find field."\n }\n ]\n }\n ]\n }\n}\n'No fallback model group found for original model_group=eit_gemini25flashimage. Fallbacks=[{'imagen-4.0-generate-001': ['imagen-4.0-fast-generate-001', 'eit_imagen3']}] Original exception: BadRequestError: litellm.BadRequestError: VertexAIException BadRequestError - b'{\n "error": {\n "code": 400,\n "message": "Invalid JSON payload received. Unknown name \\"labels\\": Cannot find field.",\n "status": "INVALID_ARGUMENT",\n "details": [\n {\n "@type": "type.googleapis.com/google.rpc.BadRequest",\n "fieldViolations": [\n {\n "description": "Invalid JSON payload received. Unknown name \\"labels\\": Cannot find field."\n }\n ]\n }\n ]\n }\n}\n'", "type": null, "param": null, "code": "503"}}
Are you a ML Ops Team?
No
What LiteLLM version are you on ?
v1.77.2.rc.1
Twitter / LinkedIn details
No response