Enum LlmError 

pub enum LlmError {
    Http(Error),
    Json(Error),
    RateLimited,
    Unavailable,
    EmptyResponse {
        provider: String,
    },
    SseParse(String),
    EmbedUnsupported {
        provider: String,
    },
    ModelLoad(String),
    Inference(String),
    NoRoute,
    NoProviders,
    StructuredParse(String),
    TranscriptionFailed(String),
    ContextLengthExceeded,
    Timeout,
    BetaHeaderRejected {
        header: String,
    },
    InvalidInput {
        provider: String,
        message: String,
    },
    Other(String),
}

Variants

Http(Error)

Json(Error)

RateLimited

Unavailable

EmptyResponse

Fields

provider: String

SseParse(String)

EmbedUnsupported

Fields

provider: String

ModelLoad(String)

Inference(String)

NoRoute

NoProviders

StructuredParse(String)

TranscriptionFailed(String)

ContextLengthExceeded

Timeout

BetaHeaderRejected

A beta header sent in the request was rejected by the API (e.g. compact-2026-01-12 deprecated or not yet available). The provider has already disabled the feature internally; the caller should retry without it.

Fields

header: String

InvalidInput

The input itself is invalid (HTTP 400). Retrying with the same input on another provider will not help — the router should break the fallback loop immediately.

Fields

provider: String

message: String

Other(String)

Implementations

impl LlmError

pub fn is_context_length_error(&self) -> bool

Returns true if this error indicates the context/prompt is too long for the model.

pub fn is_beta_header_rejected(&self) -> bool

Returns true if this error indicates that a beta header was rejected by the API.

pub fn is_invalid_input(&self) -> bool

Returns true if this error indicates that the input itself is invalid (HTTP 400).

Callers (e.g. the router fallback loop) should not retry with a different provider when this is true — the same input will fail there too.

pub fn is_rate_limited(&self) -> bool

Trait Implementations

impl Debug for LlmError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for LlmError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for LlmError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<Error> for LlmError

fn from(source: Error) -> Self

Converts to this type from the input type.

impl From<Error> for LlmError

fn from(source: Error) -> Self

Converts to this type from the input type.