evaluation case failure: UnexpectedModelBehavior: Content field missing from Gemini response #271
Description
While running the run-evals task in the push pipeline for commit abb63b5, the following evaluation case failure occurred:
Case Failures
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Case ID ┃ Inputs ┃ Error Message ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ suggest-cwe-for-CVE-2025-7647 │ CVE-2025-7647 │ UnexpectedModelBehavior: Content field missing from Gemini response, body: │
│ │ │ sdk_http_response=HttpResponse( │
│ │ │ headers=<dict len=11> │
│ │ │ ) candidates=[Candidate( │
│ │ │ finish_reason=<FinishReason.RECITATION: 'RECITATION'>, │
│ │ │ index=0 │
│ │ │ )] create_time=None model_version='gemini-2.5-flash' prompt_feedback=None response_id='LqPwaMWADI7P_uMPy5fVOQ' │
│ │ │ usage_metadata=GenerateContentResponseUsageMetadata( │
│ │ │ cache_tokens_details=[ │
│ │ │ ModalityTokenCount( │
│ │ │ modality=<MediaModality.TEXT: 'TEXT'>, │
│ │ │ token_count=10411 │
│ │ │ ), │
│ │ │ ], │
│ │ │ cached_content_token_count=10411, │
│ │ │ prompt_token_count=12059, │
│ │ │ prompt_tokens_details=[ │
│ │ │ ModalityTokenCount( │
│ │ │ modality=<MediaModality.TEXT: 'TEXT'>, │
│ │ │ token_count=12059 │
│ │ │ ), │
│ │ │ ], │
│ │ │ thoughts_token_count=891, │
│ │ │ total_token_count=12950 │
│ │ │ ) automatic_function_calling_history=[] parsed=None │
└───────────────────────────────┴───────────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
I do not know yet whether it is reproducible but wanted to record it in case it appears again.