Enum NormalizedLoadRequestError 

#[non_exhaustive]
pub enum NormalizedLoadRequestError {
    ZeroCachedShards,
    InvalidInvocationLimits {
        maximum_batch_size: i32,
        maximum_sequence_length: i32,
    },
    ReplicatedParallelTopology,
    ConflictingCompletionPolicy,
    OrphanedModelCompletion,
    ZeroEmbeddedDraftCapacity,
    UnsupportedDraftingPlan,
    Completion(String),
    Quantization(String),
}

Failure while validating or lowering a normalized cold-load request.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

ZeroCachedShards

A prepared source must have a positive reader-cache bound.

InvalidInvocationLimits

Parallel invocation limits must both be positive.

Fields

maximum_batch_size: i32

Maximum admitted batch size.

maximum_sequence_length: i32

Maximum admitted sequence length.

ReplicatedParallelTopology

A replicated topology was incorrectly attached as parallel execution.

ConflictingCompletionPolicy

A local completion setting was attached before a complete parallel request.

OrphanedModelCompletion

An ordinary model request retained a communication-only policy.

ZeroEmbeddedDraftCapacity

Embedded drafting requires positive capacity.

UnsupportedDraftingPlan

The portable planner supplied a drafting mode this runtime does not understand.

Completion(String)

The default realtime completion contract could not be constructed.

Quantization(String)

A quantization request could not be represented by the checkpoint contract.

Trait Implementations

impl Debug for NormalizedLoadRequestError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for NormalizedLoadRequestError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for NormalizedLoadRequestError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<NormalizedLoadRequestError> for ExecutionPlanLoadError

fn from(source: NormalizedLoadRequestError) -> Self

Converts to this type from the input type.