pub struct Caps {
pub max_input_tokens: Option<u64>,
pub max_output_tokens: Option<u64>,
pub max_total_tokens: Option<u64>,
pub max_cost_usd: Option<f64>,
}Expand description
Caps for a single pool. Any cap left as None is unenforced.
Fields§
§max_input_tokens: Option<u64>Cap on cumulative input tokens across all recorded calls.
max_output_tokens: Option<u64>Cap on cumulative output tokens across all recorded calls.
max_total_tokens: Option<u64>Cap on cumulative input + output tokens.
max_cost_usd: Option<f64>Cap on cumulative USD spend.
Trait Implementations§
impl Copy for Caps
impl StructuralPartialEq for Caps
Auto Trait Implementations§
impl Freeze for Caps
impl RefUnwindSafe for Caps
impl Send for Caps
impl Sync for Caps
impl Unpin for Caps
impl UnsafeUnpin for Caps
impl UnwindSafe for Caps
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more