HasSamplingConfig

Trait HasSamplingConfig 

Source
pub trait HasSamplingConfig {
    // Required method
    fn max_tokens(&self) -> u32;

    // Provided methods
    fn temperature(&self) -> Option<f64> { ... }
    fn stop_sequences(&self) -> Option<&Vec<String>> { ... }
}
Expand description

Trait for sampling configuration (from CreateMessageRequest spec)

Required Methods§

Source

fn max_tokens(&self) -> u32

Maximum tokens to generate (required field from spec)

Provided Methods§

Source

fn temperature(&self) -> Option<f64>

Temperature for sampling (optional from spec)

Source

fn stop_sequences(&self) -> Option<&Vec<String>>

Stop sequences (optional from spec)

Implementors§