Enum SamplingPreset 

pub enum SamplingPreset {
    Balanced,
    Creative,
    Precise,
    Greedy,
    Conversational,
}

Named preset for sampling behavior.

Example

use oxibonsai_runtime::presets::SamplingPreset;
use oxibonsai_runtime::sampling::SamplingParams;

// Use a preset directly
let params: SamplingParams = SamplingPreset::Balanced.into();
assert!((params.temperature - 0.7).abs() < f32::EPSILON);

// Iterate over all presets
for preset in SamplingPreset::all() {
    let p = preset.params();
    assert!(p.temperature >= 0.0);
    assert!(p.top_p >= 0.0 && p.top_p <= 1.0);
}

Variants

Balanced

General use: temp=0.7, top_p=0.9, top_k=40, rep_pen=1.1

Creative

Creative writing: temp=1.0, top_p=0.95, top_k=0 (disabled), rep_pen=1.0

Precise

Factual/code generation: temp=0.1, top_p=0.5, top_k=10, rep_pen=1.2

Greedy

Deterministic output: temp=0.0, greedy decoding

Conversational

Chat/conversation: temp=0.8, top_p=0.9, top_k=50, rep_pen=1.1

Implementations

impl SamplingPreset

pub fn params(&self) -> SamplingParams

Get the sampling parameters for this preset.

pub fn name(&self) -> &'static str

Human-readable name of this preset.

pub fn description(&self) -> &'static str

Description of this preset’s intended use case.

pub fn all() -> &'static [SamplingPreset]

Get all available presets.

Trait Implementations

impl Clone for SamplingPreset

fn clone(&self) -> SamplingPreset

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplingPreset

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for SamplingPreset

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<SamplingPreset> for SamplingParams

fn from(preset: SamplingPreset) -> Self

Converts to this type from the input type.

impl PartialEq for SamplingPreset

fn eq(&self, other: &SamplingPreset) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for SamplingPreset

impl Eq for SamplingPreset

impl StructuralPartialEq for SamplingPreset