Struct Budget 

pub struct Budget {
    pub max_tokens: Option<usize>,
    pub max_rounds: Option<usize>,
}

Window budget: token and round limits (both optional; when both are set, the smaller window wins).

• max_tokens: total token budget for the context (WindowMemory::new requires it);
• max_rounds: maximum number of complete rounds to keep. A round is one User message plus everything after it until the next User message (a tool message belongs to the same round as its Assistant).

The two dimensions can be used independently or together: when both are set, the kept result is the smaller window satisfying both (trim by tokens first, then constrained by rounds).

Example

use molo::memory::Budget;

// Token-only budget: window of at most 4096 tokens, no round limit.
let by_tokens = Budget::tokens(4096);
// Rounds-only budget: keep at most 8 rounds.
let by_rounds = Budget::rounds(8);
// Both set: the smaller window wins.
let both = Budget::both(4096, 8);

assert_eq!(by_tokens.max_tokens, Some(4096));
assert_eq!(by_tokens.max_rounds, None);
assert_eq!(by_rounds.max_rounds, Some(8));
assert!(both.max_tokens.is_some() && both.max_rounds.is_some());

Fields

max_tokens: Option<usize>

Token budget limit; None = unlimited.

max_rounds: Option<usize>

Round limit; None = unlimited.

Implementations

impl Budget

pub fn tokens(max_tokens: usize) -> Self

Token-only budget (no round limit).

pub fn rounds(max_rounds: usize) -> Self

Rounds-only budget (no token limit).

max_rounds == 0 is treated as 1 (the window always keeps the most recent round, avoiding an empty window).

pub fn both(max_tokens: usize, max_rounds: usize) -> Self

Sets both the token budget and the round limit (the smaller window wins when both are set).

max_rounds == 0 is treated as 1 (see rounds).

Trait Implementations

impl Clone for Budget

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Budget

impl Debug for Budget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Budget

fn default() -> Self

Unlimited in both dimensions (consistent with “no trimming by default”).

impl Eq for Budget

impl PartialEq for Budget

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Budget