Skip to main content

InferenceOutput

Type Alias InferenceOutput 

Source
pub type InferenceOutput = Output;

Aliased Type§

pub enum InferenceOutput {
    Text(String),
    Tokens(Vec<u32>),
    Tensor(Tensor),
    Embedding(Vec<f32>),
    Structured(Value),
    Binary(Bytes),
}

Variants§

§

Text(String)

§

Tokens(Vec<u32>)

§

Tensor(Tensor)

§

Embedding(Vec<f32>)

§

Structured(Value)

§

Binary(Bytes)