Enum PrefixRestoreDecision 

pub enum PrefixRestoreDecision<'a> {
    NoReusableEntry,
    SequenceCapacityNotReady {
        candidate_prefix_tokens: usize,
        capacity: &'a ExecutorExecutionCapacityDeferral,
    },
    RequestStateNotReady {
        candidate_prefix_tokens: usize,
        request_state: &'a ExecutorRequestStateDeferral,
    },
    NativeRestoreSkipped {
        candidate_prefix_tokens: usize,
    },
    Restored {
        candidate_prefix_tokens: usize,
    },
}

Contains lengths and typed resource evidence, never prompt/token contents.

Variants

NoReusableEntry

SequenceCapacityNotReady

Fields

candidate_prefix_tokens: usize

capacity: &'a ExecutorExecutionCapacityDeferral

RequestStateNotReady

Fields

candidate_prefix_tokens: usize

request_state: &'a ExecutorRequestStateDeferral

NativeRestoreSkipped

Fields

candidate_prefix_tokens: usize

Restored

Fields

candidate_prefix_tokens: usize

Trait Implementations

impl<'a> Debug for PrefixRestoreDecision<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> Serialize for PrefixRestoreDecision<'a>

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.