Enum RealtimeTruncation 

pub enum RealtimeTruncation {
    Auto,
    Disabled,
    RetentionRatio(RetentionRatioTruncation),
}

Available on crate feature realtime only.

The truncation strategy to use for the session.

Variants

Auto

auto is the default truncation strategy.

Disabled

disabled will disable truncation and emit errors when the conversation exceeds the input token limit.

RetentionRatio(RetentionRatioTruncation)

Retain a fraction of the conversation tokens when the conversation exceeds the input token limit. This allows you to amortize truncations across multiple turns, which can help improve cached token usage.

Trait Implementations

impl Clone for RealtimeTruncation

fn clone(&self) -> RealtimeTruncation

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RealtimeTruncation

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for RealtimeTruncation

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for RealtimeTruncation

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.