Struct PromptBudget 

pub struct PromptBudget { /* private fields */ }

Exact byte and conservative token limits for one compiled prompt.

Implementations

impl PromptBudget

pub fn new( max_bytes: usize, max_estimated_tokens: usize, ) -> Result<Self, ContextError>

Creates non-zero bounded prompt limits.

Errors

Returns an error for zero values or limits above 16 MiB / safe integer.

pub const fn max_bytes(self) -> usize

Returns exact output byte limit.

pub const fn max_estimated_tokens(self) -> usize

Returns conservative estimated-token limit.

Trait Implementations

impl Clone for PromptBudget

fn clone(&self) -> PromptBudget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for PromptBudget

impl Debug for PromptBudget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for PromptBudget

impl PartialEq for PromptBudget

fn eq(&self, other: &PromptBudget) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for PromptBudget