Skip to content

[Bug]: prometheus non blocking error #11428

@superpoussin22

Description

@superpoussin22

What happened?

see logs

Relevant log output

05:14:23 - LiteLLM:ERROR: litellm_logging.py:2079 - LiteLLM.LoggingError: [Non-Blocking] Exception occurred while success logging Traceback (most recent call last):
  File "/usr/lib/python3.13/site-packages/litellm/litellm_core_utils/litellm_logging.py", line 2011, in async_success_handler
    await callback.async_log_success_event(
    ...<4 lines>...
    )
  File "/usr/lib/python3.13/site-packages/litellm/integrations/prometheus.py", line 464, in async_log_success_event
    self._increment_top_level_request_and_spend_metrics(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        end_user_id=end_user_id,
        ^^^^^^^^^^^^^^^^^^^^^^^^
    ...<7 lines>...
        enum_values=enum_values,
        ^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/usr/lib/python3.13/site-packages/litellm/integrations/prometheus.py", line 645, in _increment_top_level_request_and_spend_metrics
    self.litellm_requests_metric.labels(**_labels).inc()
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'PrometheusLogger' object has no attribute 'litellm_requests_metric'

INFO:     ('172.18.0.1', 55068) - "WebSocket /v1/realtime?model=openai/gpt-4o-realtime-preview" [accepted]
INFO:     connection open
INFO:     172.18.0.8:53504 - "GET /metrics HTTP/1.1" 307 Temporary Redirect
INFO:     172.18.0.8:53504 - "GET /metrics/ HTTP/1.1" 200 OK
INFO:     connection closed
05:14:47 - LiteLLM:ERROR: litellm_logging.py:2079 - LiteLLM.LoggingError: [Non-Blocking] Exception occurred while success logging Traceback (most recent call last):
  File "/usr/lib/python3.13/site-packages/litellm/litellm_core_utils/litellm_logging.py", line 2011, in async_success_handler
    await callback.async_log_success_event(
    ...<4 lines>...
    )
  File "/usr/lib/python3.13/site-packages/litellm/integrations/prometheus.py", line 464, in async_log_success_event
    self._increment_top_level_request_and_spend_metrics(
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
        end_user_id=end_user_id,
        ^^^^^^^^^^^^^^^^^^^^^^^^
    ...<7 lines>...
        enum_values=enum_values,
        ^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/usr/lib/python3.13/site-packages/litellm/integrations/prometheus.py", line 645, in _increment_top_level_request_and_spend_metrics
    self.litellm_requests_metric.labels(**_labels).inc()
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'PrometheusLogger' object has no attribute 'litellm_requests_metric'

Are you a ML Ops Team?

Yes

What LiteLLM version are you on ?

v1.72.1 nightly

Twitter / LinkedIn details

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions