Skip to main content

PromptTopLogprobs

Type Alias PromptTopLogprobs 

Source
pub type PromptTopLogprobs = (Vec<Option<Vec<f64>>>, Vec<Option<Vec<i32>>>);
Expand description

Top-k alternatives per prompt position, None for the first.