Struct Warmed 

pub struct Warmed<C> { /* private fields */ }

The door a run’s requests enter the keep-warm account by: it owns the adapter a run calls and is itself the Model the turn loop is handed, so every request that reached the provider is recorded without the turn loop knowing keep-warm exists.

It forwards every call method of Model rather than inheriting a default, because a default is correct and only slower: an inherited call_speculating drops the early calls, and no read then starts while the model writes (crates/runtime/spec/Prefix.lean D97).

The clock is the caller’s, injected from the one sampling point. The door measures its endpoint’s Lead from a renewal’s round trip and from a real call’s first increment, never from a whole call, whose generation the provider’s lifetime does not wait for (D100).

Implementations

impl<C: FnMut() -> Result<TimeMs, AxError>> Warmed<C>

pub fn new( model: Box<dyn Model + Send>, setting: KeepWarm, clock: C, lead: Lead, ) -> Warmed<C>

Wraps model, which reaches the endpoint lead is read for; under KeepWarm::Off it only forwards.

pub fn next_due(&self) -> Option<u64>

See Warmth::next_due; the lead is the endpoint’s reading now.

pub fn renew_due(&mut self, now_ms: u64) -> RenewalRound

Sends every renewal due by now_ms through the adapter this door owns, and takes each one’s round trip as the endpoint’s lead: a renewal asks for one token, so its answer follows the prefill. A clock or adapter failure ends the round as its refusal.

Trait Implementations

impl<C: FnMut() -> Result<TimeMs, AxError>> Model for Warmed<C>

fn provider_account(&self) -> Option<ProviderAccountBinding>

The non-secret identity recorded before each actual request: the roster’s provider and current account, answered without asking the vault.

fn account_roster(&self) -> Option<AccountRoster>

The accounts this adapter can call as; None for an adapter with no named account. With two accounts or more each entry’s usable asks the vault, so a caller asks once per round.

fn select_account(&mut self, account: &ServerLabel)

Selects the account every later request of this adapter uses, without sending a request; a name outside the roster leaves the selection as it was. The credential is redeemed at call time, so selecting cannot fail.

fn prefix_held(&self) -> Option<PrefixHeld>

The wait the last call took at its endpoint’s gate behind a pre-warm of its shared prefix (crates/kernel/spec/Model.lean D60); None when it took none. Asked after every attempt, on success and on failure, by the turn that writes the prefix_held line; an adapter with no gate answers None.

fn call(&mut self, req: &ModelRequest<'_>) -> Result<ModelReturn, AxError>

fn call_streaming( &mut self, req: &ModelRequest<'_>, onto: Increments<'_>, ) -> Result<ModelReturn, AxError>

The same call, reporting text as it arrives.

fn call_speculating( &mut self, req: &ModelRequest<'_>, onto: Increments<'_>, early: EarlyCalls<'_>, ) -> Result<ModelReturn, AxError>

The streaming call, also handing over each tool call as soon as it is complete.