pub enum LlmLimitKind {
PerExecutionTokens {
requested: u64,
limit: u64,
},
AllExecutionsTokens {
requested: u64,
limit: u64,
},
IndeterminateSpend {
held: u64,
limit: u64,
},
}Expand description
Which token ceiling a refused dispatch ran into. Carries the numbers, never
the prompts — the same rule
SessionKvLimitKind
follows for values.
Variants§
PerExecutionTokens
This execution’s own token ceiling.
AllExecutionsTokens
The server-wide budget summed across every live execution. Distinct from
Self::PerExecutionTokens because it wants the opposite response: the
tokens in the way belong to other executions, so this execution making
fewer or shorter calls need not help.
IndeterminateSpend
Cumulative reserve held for elements whose usage the provider never reported. Token spend is monotonic — unlike session-KV bytes, a held estimate is never superseded by a real number — so without this bound a long-lived execution ratchets toward zero with no recovery. Distinct from a genuine overspend so an operator can tell a null-usage storm from real consumption.
Trait Implementations§
Source§impl Clone for LlmLimitKind
impl Clone for LlmLimitKind
impl Copy for LlmLimitKind
Source§impl Debug for LlmLimitKind
impl Debug for LlmLimitKind
Source§impl Display for LlmLimitKind
impl Display for LlmLimitKind
impl Eq for LlmLimitKind
Source§impl PartialEq for LlmLimitKind
impl PartialEq for LlmLimitKind
impl StructuralPartialEq for LlmLimitKind
Auto Trait Implementations§
impl Freeze for LlmLimitKind
impl RefUnwindSafe for LlmLimitKind
impl Send for LlmLimitKind
impl Sync for LlmLimitKind
impl Unpin for LlmLimitKind
impl UnsafeUnpin for LlmLimitKind
impl UnwindSafe for LlmLimitKind
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.