Enum InferenceError 

#[non_exhaustive]
pub enum InferenceError {
    RateLimited {
        provider: ProviderKind,
        retry_after: Option<Duration>,
    },
    CircuitOpen {
        provider: ProviderKind,
        opened_at_unix_ms: u64,
        retry_at_unix_ms: u64,
    },
    ContentFiltered {
        reason: String,
    },
    ContextLengthExceeded {
        tokens: u32,
        max_tokens: u32,
    },
    BadRequest {
        message: String,
    },
    Unauthorized {
        message: String,
    },
    Forbidden {
        message: String,
    },
    Backpressure(String),
    BudgetExceeded {
        deployment: String,
    },
    NetworkError(String),
    ServerError {
        status: u16,
        body: Option<String>,
    },
    Timeout {
        elapsed_ms: u64,
    },
    CudaContextPoisoned(String),
    Internal(String),
}

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

RateLimited

429 from a remote provider. Worker backs off and retries unless max_retries is exhausted; then this surfaces to the request.

Fields

provider: ProviderKind

retry_after: Option<Duration>

CircuitOpen

Circuit breaker is open for (provider, endpoint). Fail-fast.

Fields

provider: ProviderKind

opened_at_unix_ms: u64

retry_at_unix_ms: u64

ContentFiltered

Provider safety filter rejected the input/output. Not retryable.

Fields

reason: String

ContextLengthExceeded

Input exceeded the model’s context window. Not retryable.

Fields

tokens: u32

max_tokens: u32

BadRequest

400 from the provider — caller-side bug.

Fields

message: String

Unauthorized

401 — triggers RemoteSessionActor::rebuild.

Fields

message: String

Forbidden

403 — model/feature access denied.

Fields

message: String

Backpressure(String)

Mailbox / engine queue full. Upstream decides fallback / 429.

BudgetExceeded

Spend ceiling reached (doc §12.4).

Fields

deployment: String

NetworkError(String)

Network blip below the HTTP layer.

ServerError

5xx from provider. Counts toward circuit breaker.

Fields

status: u16

body: Option<String>

Timeout

Request or read timeout.

Fields

elapsed_ms: u64

CudaContextPoisoned(String)

Local CUDA context poisoned (sticky failure). Triggers two-tier rebuild on the local WorkerActor → ContextActor boundary.

Internal(String)

Catch-all for runtime-internal bugs. Not retryable.

Implementations

impl InferenceError

pub fn is_retryable(&self) -> bool

pub fn counts_as_circuit_failure(&self) -> bool

Whether this error counts toward the circuit-breaker failure budget. 429s and content-filter refusals do not (doc §12.2).

Trait Implementations

impl Clone for InferenceError

fn clone(&self) -> InferenceError

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for InferenceError

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for InferenceError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for InferenceError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl Serialize for InferenceError

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.