OKi*SrSSKJr SSKrSSKrSSKJr SSKJr SSK J r J r J r J r Jr SSKJrJrJrJrJrJr \(aSSKJrJr "S S \\\\\45rg) z"Model retry middleware for agents.) annotationsN) TYPE_CHECKING) AIMessage) OnFailureRetryOncalculate_delayshould_retry_exceptionvalidate_retry_params)AgentMiddleware AgentStateContextT ModelRequest ModelResponse ResponseT) AwaitableCallablec^\rSrSrSrS\4SSSSSS .SU4S jjjr\SS j5rSS jr SS jr SSjr Sr U=r $)ModelRetryMiddlewarea4Middleware that automatically retries failed model calls with configurable backoff. Supports retrying on specific exceptions and exponential backoff. Examples: !!! example "Basic usage with default settings (2 retries, exponential backoff)" ```python from langchain.agents import create_agent from langchain.agents.middleware import ModelRetryMiddleware agent = create_agent(model, tools=[search_tool], middleware=[ModelRetryMiddleware()]) ``` !!! example "Retry specific exceptions only" ```python from anthropic import RateLimitError from openai import APITimeoutError retry = ModelRetryMiddleware( max_retries=4, retry_on=(APITimeoutError, RateLimitError), backoff_factor=1.5, ) ``` !!! example "Custom exception filtering" ```python from anthropic import APIStatusError def should_retry(exc: Exception) -> bool: # Only retry on 5xx errors if isinstance(exc, APIStatusError): return 500 <= exc.status_code < 600 return False retry = ModelRetryMiddleware( max_retries=3, retry_on=should_retry, ) ``` !!! example "Custom error handling" ```python def format_error(exc: Exception) -> str: return "Model temporarily unavailable. Please try again later." retry = ModelRetryMiddleware( max_retries=4, on_failure=format_error, ) ``` !!! example "Constant backoff (no exponential growth)" ```python retry = ModelRetryMiddleware( max_retries=5, backoff_factor=0.0, # No exponential growth initial_delay=2.0, # Always wait 2 seconds ) ``` !!! example "Raise exception on failure" ```python retry = ModelRetryMiddleware( max_retries=2, on_failure="error", # Re-raise exception instead of returning message ) ``` continueg@g?gN@T) max_retriesretry_on on_failurebackoff_factor initial_delay max_delayjitterc>[TU]5 [XXd5 Xl/UlX lX0lX@lXPlX`l Xpl g)uInitialize `ModelRetryMiddleware`. Args: max_retries: Maximum number of retry attempts after the initial call. Must be `>= 0`. retry_on: Either a tuple of exception types to retry on, or a callable that takes an exception and returns `True` if it should be retried. Default is to retry on all exceptions. on_failure: Behavior when all retries are exhausted. Options: - `'continue'`: Return an `AIMessage` with error details, allowing the agent to continue with an error response. - `'error'`: Re-raise the exception, stopping agent execution. - **Custom callable:** Function that takes the exception and returns a string for the `AIMessage` content, allowing custom error formatting. backoff_factor: Multiplier for exponential backoff. Each retry waits `initial_delay * (backoff_factor ** retry_number)` seconds. Set to `0.0` for constant delay. initial_delay: Initial delay in seconds before first retry. max_delay: Maximum delay in seconds between retries. Caps exponential backoff growth. jitter: Whether to add random jitter (`±25%`) to delay to avoid thundering herd. Raises: ValueError: If `max_retries < 0` or delays are negative. N) super__init__r rtoolsrrrrrr) selfrrrrrrr __class__s i/var/www/html/dynamic-report/venv/lib/python3.13/site-packages/langchain/agents/middleware/model_retry.pyr!ModelRetryMiddleware.__init__osJ\  k)T&  $,*" c[U5Rn[U5nUS:XaSOSnSUSUSUSU3n[US9$) zFormat the failure message when retries are exhausted. Args: exc: The exception that caused the failure. attempts_made: Number of attempts actually made. Returns: `AIMessage` with formatted error message. attemptattemptszModel call failed after  z with z: content)type__name__strr)exc attempts_madeexc_typeexc_msg attempt_wordr.s r%_format_failure_message,ModelRetryMiddleware._format_failure_messages[9%%c($1Q$6yJ &}oQ|nF8*TVW^V_ ` ))r'cURS:XaUe[UR5(aURU5n[US9nOURX5n[ U/S9$)aHandle failure when all retries are exhausted. Args: exc: The exception that caused the failure. attempts_made: Number of attempts actually made. Returns: `ModelResponse` with error details. Raises: Exception: If `on_failure` is `'error'`, re-raises the exception. errorr-)result)rcallablerr7r)r#r2r3r.ai_msgs r%_handle_failure$ModelRetryMiddleware._handle_failuresY ??g %I DOO $ $ooc*Gw/F11#EFVH--r'c [URS-5H nU"U5s $ Sn[U5e![anUS-n[X@R5(dUR XE5sSnAs $X0R:a][ UURURURURS9nUS:a[R"U5 SnAMSnAMUR XE5sSnAs $SnAff=f)alIntercept model execution and retry on failure. Args: request: Model request with model, messages, state, and runtime. handler: Callable to execute the model (can be called multiple times). Returns: `ModelResponse` or `AIMessage` (the final result). Raises: RuntimeError: If the retry loop completes without returning. (This should not happen.) r)Nrrrrr2Unexpected: retry loop completed without returning)ranger Exceptionr rr>rrrrrtimesleep RuntimeErrorr#requesthandlerr*r2r3delaymsgs r%wrap_model_call$ModelRetryMiddleware.wrap_model_calls$T--12G Dw''3:C37 D '! .c==AA//CC---+'+':':&*&8&8"&..#{{ Eqy 5))!  //CC/ Ds.6 D/C;/D7A C;#C;3D;Dc 4# [URS-5HnU"U5IShvN s $ Sn[U5eN![anUS-n[X@R5(dUR XE5sSnAs $X0R:af[ UURURURURS9nUS:a%[R"U5IShvN SnAMSnAMUR XE5sSnAs $SnAff=f7f)a}Intercept and control async model execution with retry logic. Args: request: Model request with model, messages, state, and runtime. handler: Async callable to execute the model and returns `ModelResponse`. Returns: `ModelResponse` or `AIMessage` (the final result). Raises: RuntimeError: If the retry loop completes without returning. (This should not happen.) r)NrArrB)rCrrDr rr>rrrrrasynciorFrGrHs r%awrap_model_call%ModelRetryMiddleware.awrap_model_calls$T--12G D$W---3:C39. D '! .c==AA//CC---+'+':':&*&8&8"&..#{{ Eqy%mmE222!  //CC/ DsnD AAADA D /D;D<DA#D&C)'D, D8DD DDD)rrrrrrrr")rintrrrrrfloatrrTrrTrboolreturnNone)r2rDr3rSrVr)r2rDr3rSrVzModelResponse[ResponseT])rIModelRequest[ContextT]rJzrMrQ__static_attributes__ __classcell__)r$s@r%rrsMd&L * #":: :  :  :::: ::x**$.00 '0 N0  . 0 d0 '0 Y0  . 0 0 r'r)r] __future__rrPrEtypingrlangchain_core.messagesr"langchain.agents.middleware._retryrrrr r !langchain.agents.middleware.typesr r r rrrcollections.abcrrrr'r%rhsR(" -3Y ?:i+@(I+UVY r'