Skip to main content

TextLmRequest

llama_runner

Type Alias TextLmRequest 

Source 
pub type TextLmRequest<'a> = RunnerRequest<&'a str>;

Aliased Type§

pub struct TextLmRequest<'a> {
    pub messages: Vec<(MessageRole, &'a str)>,
    pub sampling: SimpleSamplingParams,
    pub llguidance: Option<LlguidanceSamplingParams>,
    pub max_seq: usize,
    pub prefill: Option<String>,
}

Fields§

§messages: Vec<(MessageRole, &'a str)>§sampling: SimpleSamplingParams§llguidance: Option<LlguidanceSamplingParams>§max_seq: usize§prefill: Option<String>