-
-
Notifications
You must be signed in to change notification settings - Fork 3.7k
Open
Labels
Description
What happened?
see logs
Relevant log output
05:14:23 - LiteLLM:ERROR: litellm_logging.py:2079 - LiteLLM.LoggingError: [Non-Blocking] Exception occurred while success logging Traceback (most recent call last):
File "/usr/lib/python3.13/site-packages/litellm/litellm_core_utils/litellm_logging.py", line 2011, in async_success_handler
await callback.async_log_success_event(
...<4 lines>...
)
File "/usr/lib/python3.13/site-packages/litellm/integrations/prometheus.py", line 464, in async_log_success_event
self._increment_top_level_request_and_spend_metrics(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
end_user_id=end_user_id,
^^^^^^^^^^^^^^^^^^^^^^^^
...<7 lines>...
enum_values=enum_values,
^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/usr/lib/python3.13/site-packages/litellm/integrations/prometheus.py", line 645, in _increment_top_level_request_and_spend_metrics
self.litellm_requests_metric.labels(**_labels).inc()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'PrometheusLogger' object has no attribute 'litellm_requests_metric'
INFO: ('172.18.0.1', 55068) - "WebSocket /v1/realtime?model=openai/gpt-4o-realtime-preview" [accepted]
INFO: connection open
INFO: 172.18.0.8:53504 - "GET /metrics HTTP/1.1" 307 Temporary Redirect
INFO: 172.18.0.8:53504 - "GET /metrics/ HTTP/1.1" 200 OK
INFO: connection closed
05:14:47 - LiteLLM:ERROR: litellm_logging.py:2079 - LiteLLM.LoggingError: [Non-Blocking] Exception occurred while success logging Traceback (most recent call last):
File "/usr/lib/python3.13/site-packages/litellm/litellm_core_utils/litellm_logging.py", line 2011, in async_success_handler
await callback.async_log_success_event(
...<4 lines>...
)
File "/usr/lib/python3.13/site-packages/litellm/integrations/prometheus.py", line 464, in async_log_success_event
self._increment_top_level_request_and_spend_metrics(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
end_user_id=end_user_id,
^^^^^^^^^^^^^^^^^^^^^^^^
...<7 lines>...
enum_values=enum_values,
^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/usr/lib/python3.13/site-packages/litellm/integrations/prometheus.py", line 645, in _increment_top_level_request_and_spend_metrics
self.litellm_requests_metric.labels(**_labels).inc()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'PrometheusLogger' object has no attribute 'litellm_requests_metric'
Are you a ML Ops Team?
Yes
What LiteLLM version are you on ?
v1.72.1 nightly
Twitter / LinkedIn details
No response