Enum GenerateParam 

pub enum GenerateParam {
    Temperature,
    TopP,
    TopK,
    MaxTokens,
    StopSequences,
    FrequencyPenalty,
    PresencePenalty,
    Seed,
    ResponseFormat,
    ExtendedThinking,
}

Cost model for routing optimization. Generation parameters that a model may or may not support. Models declare which params they accept. The inference layer strips unsupported params before sending to the API.

Variants

Temperature

TopP

TopK

MaxTokens

StopSequences

FrequencyPenalty

PresencePenalty

Seed

ResponseFormat

ExtendedThinking

Extended thinking / internal reasoning before responding.

Trait Implementations

impl Clone for GenerateParam

fn clone(&self) -> GenerateParam

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GenerateParam

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for GenerateParam

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Hash for GenerateParam

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for GenerateParam

fn eq(&self, other: &GenerateParam) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for GenerateParam

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for GenerateParam

impl Eq for GenerateParam

impl StructuralPartialEq for GenerateParam