Struct RequestedSampling 

pub struct RequestedSampling {
    pub temperature: Option<f32>,
    pub top_p: Option<f32>,
    pub top_k: Option<usize>,
}

The sampling fields one request actually specified. None means the request said nothing about that field, so the checkpoint’s recommendation (and then the framework default) may speak for it.

Collapsing this to a plain SamplingParams at the wire boundary – temperature: req.temperature.unwrap_or(0.0) – is what destroys the distinction: a request that omitted temperature becomes indistinguishable from one that explicitly asked for greedy, and no recommendation can ever apply.

Fields

temperature: Option<f32>

top_p: Option<f32>

top_k: Option<usize>

Trait Implementations

impl Clone for RequestedSampling

fn clone(&self) -> RequestedSampling

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for RequestedSampling

impl Debug for RequestedSampling

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RequestedSampling

fn default() -> RequestedSampling

Returns the “default value” for a type.

impl PartialEq for RequestedSampling

fn eq(&self, other: &RequestedSampling) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for RequestedSampling