pub struct TokenBudget {
pub total_tokens: usize,
pub reserved_system: usize,
pub reserved_query: usize,
pub reserved_response: usize,
pub per_doc_overhead: usize,
}Expand description
Token budget configuration per CP-021 §3.
Fields§
§total_tokens: usizeMaximum total context tokens
reserved_system: usizeReserved for system prompt
reserved_query: usizeReserved for user query
reserved_response: usizeReserved for generation output
per_doc_overhead: usizeTokens per document marker overhead
Implementations§
Trait Implementations§
Source§impl Clone for TokenBudget
impl Clone for TokenBudget
Source§fn clone(&self) -> TokenBudget
fn clone(&self) -> TokenBudget
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TokenBudget
impl Debug for TokenBudget
Auto Trait Implementations§
impl Freeze for TokenBudget
impl RefUnwindSafe for TokenBudget
impl Send for TokenBudget
impl Sync for TokenBudget
impl Unpin for TokenBudget
impl UnsafeUnpin for TokenBudget
impl UnwindSafe for TokenBudget
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more