Struct OnTokenBudget 

pub struct OnTokenBudget {
    pub max_bytes: usize,
}

Trigger consolidation when the buffer’s total text length (summed UTF-8 byte length of every ContentPart::Text) exceeds max_bytes. Approximates a token-budget gate without needing a tokenizer in the SDK.

Fields

max_bytes: usize

Maximum cumulative text bytes before consolidation fires.

Implementations

impl OnTokenBudget

pub const fn new(max_bytes: usize) -> Self

Build a policy with the given byte threshold.

Trait Implementations

impl Clone for OnTokenBudget

fn clone(&self) -> OnTokenBudget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl ConsolidationPolicy for OnTokenBudget

fn should_consolidate(&self, ctx: &ConsolidationContext<'_>) -> bool

Return true when the buffer is ready for consolidation.

impl Debug for OnTokenBudget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for OnTokenBudget

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for OnTokenBudget

fn eq(&self, other: &OnTokenBudget) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for OnTokenBudget

impl Eq for OnTokenBudget

impl StructuralPartialEq for OnTokenBudget