Skip to main content

CallOptions

llmsdk_provider

Struct CallOptions

pub struct CallOptions {Show 16 fields
    pub prompt: Prompt,
    pub max_output_tokens: Option<u32>,
    pub temperature: Option<f32>,
    pub stop_sequences: Option<Vec<String>>,
    pub top_p: Option<f32>,
    pub top_k: Option<u32>,
    pub presence_penalty: Option<f32>,
    pub frequency_penalty: Option<f32>,
    pub response_format: Option<ResponseFormat>,
    pub seed: Option<u64>,
    pub tools: Option<Vec<Tool>>,
    pub tool_choice: Option<ToolChoice>,
    pub include_raw_chunks: Option<bool>,
    pub headers: Option<Headers>,
    pub reasoning: Option<ReasoningEffort>,
    pub provider_options: Option<ProviderOptions>,
}

Expand description

Options for one model invocation.

Built directly; only prompt is required.

Fields§

§prompt: Prompt

Standardized prompt; not the user-facing prompt.

§max_output_tokens: Option<u32>

Hard cap on generated tokens.

§temperature: Option<f32>

Sampling temperature.

§stop_sequences: Option<Vec<String>>

Stop sequences (provider may cap the count).

§top_p: Option<f32>

Nucleus sampling.

§top_k: Option<u32>

Top-K sampling.

§presence_penalty: Option<f32>

Presence penalty.

§frequency_penalty: Option<f32>

Frequency penalty.

§response_format: Option<ResponseFormat>

Desired response format. None = provider default (text).

§seed: Option<u64>

Sampling seed.

§tools: Option<Vec<Tool>>

Available tools.

§tool_choice: Option<ToolChoice>

Tool-selection policy.

§include_raw_chunks: Option<bool>

Include raw chunks in the stream (do_stream only).

§headers: Option<Headers>

Extra HTTP headers (HTTP providers only).

§reasoning: Option<ReasoningEffort>

Reasoning effort.

§provider_options: Option<ProviderOptions>

Provider-specific options.

Trait Implementations§

impl Clone for CallOptions

fn clone(&self) -> CallOptions

Returns a duplicate of the value. Read more

1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more

impl Debug for CallOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

impl Default for CallOptions

fn default() -> CallOptions

Returns the “default value” for a type. Read more

impl<'de> Deserialize<'de> for CallOptions

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more

impl Serialize for CallOptions

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>
where S: Serializer,

Serialize this value into the given Serde serializer. Read more

Auto Trait Implementations§

impl Freeze for CallOptions

impl RefUnwindSafe for CallOptions

impl Send for CallOptions

impl Sync for CallOptions

impl Unpin for CallOptions

impl UnsafeUnpin for CallOptions

impl UnwindSafe for CallOptions

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> CloneToUninit for T
where T: Clone,

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)

Performs copy-assignment from self to dest. Read more

impl<T> DynClone for T
where T: Clone,

fn __clone_box(&self, _: Private) -> *mut ()

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T> ToOwned for T
where T: Clone,

type Owned = T

The resulting type after obtaining ownership.

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,