Struct LlmLimits 

pub struct LlmLimits {
    pub per_execution_tokens: u64,
    pub max_held_tokens: u64,
    pub default_output_cap: u64,
    pub max_prompt_count: u64,
    pub max_prompt_bytes: u64,
}

The ceilings a dispatch is checked against.

Token ceilings and prompt bounds live in one struct deliberately: an operator raising how much a program may spend almost always means to raise how much it may send, and splitting them across two config surfaces makes that two edits with a silent failure between them.

Fields

per_execution_tokens: u64

Tokens one execution may spend in total.

max_held_tokens: u64

Tokens one execution may hold as indeterminate reserve before further dispatch is refused.

default_output_cap: u64

Output tokens reserved per prompt when the model declares no outputReserve of its own.

max_prompt_count: u64

Elements in one batch slice. Enforced at the stdlib boundary.

max_prompt_bytes: u64

UTF-8 bytes in a single prompt element. Enforced at the stdlib boundary.

Trait Implementations

impl Clone for LlmLimits

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for LlmLimits

impl Debug for LlmLimits

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LlmLimits

fn default() -> Self

Returns the “default value” for a type.

impl Eq for LlmLimits

impl PartialEq for LlmLimits

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for LlmLimits