Struct AgentBudget 

pub struct AgentBudget {
    pub connect: Duration,
    pub write: Duration,
    pub overall: Duration,
}

The three timeout ceilings a remote-inference agent is built from.

A budget, not an agent: the values are role knowledge (an embedding that has not answered in a minute is not going to; a generation legitimately takes hundreds of seconds), so they stay declared next to the role. What lives here is the shape — which knobs exist and what they actually do — because it was declared four times over three files, each copy one edit away from drifting from the others.

Fields

connect: Duration

Ceiling on establishing the TCP connection. The one knob that genuinely changes behavior over ureq’s defaults: its own connect default is 30 s (agent.rs) — sane for the open internet, absurd for a daemon on localhost, which either accepts immediately or is not running. With replays, that idle wait would be paid three times over.

write: Duration

Ceiling on writing the request. Applied to the socket at connect time, so — unlike the read deadline — it is in force independently of the overall budget.

overall: Duration

Whole-request deadline, connect included.

Implementations

impl AgentBudget

pub const fn local_daemon(overall: Duration) -> Self

Budget for a model daemon expected on localhost: 2 s to connect, 10 s to write, overall to answer. The connect and write figures are shared by the embedding and extraction roles on purpose — they bound the transport to a local daemon, which is the same transport for both; only overall is role knowledge.

pub const fn uniform(budget: Duration) -> Self

One figure for every ceiling — for probes whose caller states a single whole budget and means it.

Trait Implementations

impl Clone for AgentBudget

fn clone(&self) -> AgentBudget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for AgentBudget

impl Debug for AgentBudget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.