pub struct InferenceSendBudget { /* private fields */ }Expand description
A cloneable, request-local ceiling on inference HTTP sends.
Attestation, token refresh, and other control-plane requests do not consume this budget. A permit is reserved only immediately before an inference HTTP request is sent.
Implementations§
Source§impl InferenceSendBudget
impl InferenceSendBudget
Trait Implementations§
Source§impl Clone for InferenceSendBudget
impl Clone for InferenceSendBudget
Auto Trait Implementations§
impl Freeze for InferenceSendBudget
impl RefUnwindSafe for InferenceSendBudget
impl Send for InferenceSendBudget
impl Sync for InferenceSendBudget
impl Unpin for InferenceSendBudget
impl UnsafeUnpin for InferenceSendBudget
impl UnwindSafe for InferenceSendBudget
Blanket Implementations§
Source§impl<'a, T, E> AsTaggedExplicit<'a, E> for Twhere
T: 'a,
impl<'a, T, E> AsTaggedExplicit<'a, E> for Twhere
T: 'a,
Source§impl<'a, T, E> AsTaggedImplicit<'a, E> for Twhere
T: 'a,
impl<'a, T, E> AsTaggedImplicit<'a, E> for Twhere
T: 'a,
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more