Standardizing provider specific errors, mainly for rate limit and timeout errors #31832
ai-learner-00
announced in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Checked
Feature request
Are there any plans to standardize provider specific errors such as openai.RateLimitError and LengthFinishReasonError?
Motivation
Currently we would have to figure out the error returned by each provider, which takes time and potentially requires trying to reproduce them.
Proposal (If applicable)
A class that looks like
langchain.RateLimitError(original_error, num_retries, time of each retries or other info...)
emitted by the LLM objects and potentially a way to pass an objectRetryConfig(max_retries, jitter, exponential_backoff, max_retry_delay, ...
to customize the retry logic.Beta Was this translation helpful? Give feedback.
All reactions