Struct SageMakerPayloadConfig 

pub struct SageMakerPayloadConfig {
    pub max_tokens: Option<u32>,
    pub stream: bool,
    pub temperature: Option<f64>,
    pub top_p: Option<f64>,
    pub top_k: Option<u32>,
    pub stop: Option<Vec<String>>,
    pub tool_results_as_user_messages: bool,
    pub additional_args: Option<HashMap<String, Value>>,
}

Payload configuration for SageMaker.

Fields

max_tokens: Option<u32>

Maximum number of tokens to generate.

stream: bool

Whether to stream the response.

temperature: Option<f64>

Sampling temperature.

top_p: Option<f64>

Top-p (nucleus sampling).

top_k: Option<u32>

Top-k sampling.

stop: Option<Vec<String>>

Stop sequences.

tool_results_as_user_messages: bool

Convert tool results to user messages.

additional_args: Option<HashMap<String, Value>>

Additional arguments.

Implementations

impl SageMakerPayloadConfig

pub fn new() -> Self

Create a new payload config.

pub fn with_max_tokens(self, max_tokens: u32) -> Self

Set max tokens.

pub fn with_temperature(self, temperature: f64) -> Self

Set temperature.

pub fn with_stream(self, stream: bool) -> Self

Set streaming mode.

Trait Implementations

impl Clone for SageMakerPayloadConfig

fn clone(&self) -> SageMakerPayloadConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SageMakerPayloadConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SageMakerPayloadConfig

fn default() -> SageMakerPayloadConfig

Returns the “default value” for a type.