Struct ResolvedModelLimits 

pub struct ResolvedModelLimits {
    pub max_output_tokens: u32,
    pub max_output_tokens_source: LimitSource,
    pub context_window: Option<u32>,
    pub context_window_source: LimitSource,
    pub max_input_tokens: Option<u32>,
    pub max_input_tokens_source: LimitSource,
    pub input_budget: Option<u32>,
    pub input_budget_basis: BudgetBasis,
}

One driver choice’s output cap, context window, input ceiling and input budget in force, and where each came from. The model_limits object of session_start and of each inference_choices element.

Fields

max_output_tokens: u32

The max_tokens every agent-loop call under this choice sends, unless a controller has changed inference.max_tokens.

max_output_tokens_source: LimitSource

LimitSource::Manifest or LimitSource::Driver.

context_window: Option<u32>

The window the input budget is cut from; None when neither the manifest nor the driver gives one.

context_window_source: LimitSource

max_input_tokens: Option<u32>

The most input tokens the driver says the provider accepts for the model.

max_input_tokens_source: LimitSource

LimitSource::Driver when the table entry declares one, else LimitSource::None.

input_budget: Option<u32>

Self::input_budget_for max_output_tokens: what compaction and the seed budget measure against until a controller changes the cap. None with no window.

input_budget_basis: BudgetBasis

Implementations

impl ResolvedModelLimits

pub fn input_budget_for(&self, cap: u32) -> Option<InputBudget>

The input budget of a call under this choice that sends cap as its output cap; None with no window.

Trait Implementations

impl Clone for ResolvedModelLimits

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ResolvedModelLimits

impl Debug for ResolvedModelLimits

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ResolvedModelLimits

impl PartialEq for ResolvedModelLimits

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for ResolvedModelLimits

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ResolvedModelLimits