Struct ModelOptions 

pub struct ModelOptions {
    pub temperature: Option<f32>,
    pub max_tokens: Option<u32>,
    pub extra: BTreeMap<String, Value>,
    pub structured: Option<Value>,
}

Model options for one conversation.

Common parameters are provided as typed fields (temperature / max tokens, where None means vendor default); vendor-specific or framework-unknown parameters go into extra and are passed through to the vendor verbatim under their wire field names — so users can use new parameters without waiting for a framework update:

use molo::ModelOptions;

let mut options = ModelOptions::default();
options.extra.insert("top_p".into(), serde_json::json!(0.9));

Extra keys that collide with framework-managed fields are ignored in favor of the typed fields.

Fields

temperature: Option<f32>

Sampling temperature; None means vendor default.

max_tokens: Option<u32>

Maximum number of tokens for the reply; None means vendor default.

extra: BTreeMap<String, Value>

Vendor extension parameters: keys are wire request field names, serialized into the request body verbatim.

structured: Option<Value>

Structured output: the final answer must be JSON conforming to this JSON Schema document (the serialized RootSchema produced by schemars, or a hand-written schema).

Two layers of semantics:

• Provider side: compatible endpoints receive it via response_format to best-effort constrain the model (the OpenAI-compatible json_schema shape; unsupported endpoints ignore it or error);
• Agent side: the final answer is validated framework-side, and on mismatch the validation error is fed back to the model for a retry (counted against the turn budget by the agent runtime’s structured output support).

None = free-form text reply.

Trait Implementations

impl Clone for ModelOptions

fn clone(&self) -> ModelOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ModelOptions

fn default() -> ModelOptions

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ModelOptions

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ModelOptions

fn eq(&self, other: &ModelOptions) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for ModelOptions

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ModelOptions