Struct GenerationOptions 

pub struct GenerationOptions { /* private fields */ }

Generation knobs. All fields are optional; unset fields keep the model’s defaults.

Examples

use foundation_models::{GenerationOptions, SamplingMode};

let opts = GenerationOptions::new()
    .with_temperature(0.7)
    .with_maximum_response_tokens(500)
    .with_sampling(SamplingMode::TopP(0.9));

Implementations

impl GenerationOptions

pub const fn new() -> Self

Create options with all fields set to their defaults.

pub const fn with_temperature(self, temperature: f64) -> Self

Sampling temperature; higher values produce more varied output. FoundationModels accepts values in 0.0..=2.0.

pub const fn with_maximum_response_tokens(self, tokens: u32) -> Self

Hard cap on the number of tokens the model may emit.

pub const fn with_sampling(self, mode: SamplingMode) -> Self

Override the sampling strategy.

Trait Implementations

impl Clone for GenerationOptions

fn clone(&self) -> GenerationOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GenerationOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for GenerationOptions

fn default() -> GenerationOptions

Returns the “default value” for a type.

impl Copy for GenerationOptions