Enum LLMCallState 

pub enum LLMCallState {
    Normal = 0,
    Waiting = 1,
    Finish = 2,
    Error = 3,
    GetLastHiddenLayer = 4,
}

Represents the state of an LLM call.

Variants

Normal = 0

The LLM call is in a normal running state.

Waiting = 1

The LLM call is waiting for a complete UTF-8 encoded character.

Finish = 2

The LLM call has finished execution.

Error = 3

An error occurred during the LLM call.

GetLastHiddenLayer = 4

Retrieve the last hidden layer during inference.

Trait Implementations

impl Debug for LLMCallState

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for LLMCallState

fn eq(&self, other: &LLMCallState) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for LLMCallState

impl StructuralPartialEq for LLMCallState