Skip to main content

memory_budget_tokens

Function memory_budget_tokens 

Source
pub fn memory_budget_tokens(
    effective_provider_input_capacity: u64,
) -> Option<u64>
Expand description

The memory recall budget for a request, per spec §10.3 exactly: min(4096, 10% of effective_provider_input_capacity) estimated tokens, or None (skip recall) when the computed value falls below the MEMORY_BUDGET_MIN_TOKENS floor. Pure — no engine state is read.