Skip to main content

TurnBudgetMeter

Struct TurnBudgetMeter 

Source
pub struct TurnBudgetMeter { /* private fields */ }
Expand description

One turn’s running budget meter. NOT thread-shared: owned by the stream loop; the only cross-task input is the UsageCounters cell.

Implementations§

Source§

impl TurnBudgetMeter

Source

pub fn new(budget: TurnBudget) -> Self

Source

pub fn budget(&self) -> &TurnBudget

Source

pub fn begin_round(&mut self) -> Result<(), BudgetDimension>

Charge one provider round. Checked BEFORE the provider call: wall-clock first (a stale turn must not spend another request), then the exact round cap.

Source

pub fn try_renew_rounds(&mut self) -> Option<u32>

Attempt a bounded graceful extension after the provider-round cap is hit. Resets the round counter and returns the number of renewals still remaining, or None when the renewal budget is exhausted. Wall-clock is deliberately untouched — Self::begin_round re-checks it, so a stale turn cannot extend past max_elapsed. Only meaningful right after begin_round returned BudgetDimension::ProviderRounds.

Source

pub fn round_renewals_used(&self) -> u32

Number of graceful round renewals already consumed this turn.

Source

pub fn elapsed(&self) -> Duration

Wall-clock consumed by this turn so far. Diagnostics only — the enforcement path uses Self::wall_clock_exceeded.

Source

pub fn exhaustion_error(&self, dimension: BudgetDimension) -> TurnError

Metadata-only diagnostic; preserve the typed outcome for every frontend and autonomous driver. Exhaustion is a local stop, not provider fallback.

Source

pub fn rounds_used(&self) -> u32

Provider rounds charged since the last renewal (reset by Self::try_renew_rounds). Diagnostics only.

Source

pub fn tool_calls_used(&self) -> u32

Tool calls charged this turn. Diagnostics only.

Source

pub fn tool_result_bytes_used(&self) -> usize

Accumulated tool-result bytes charged this turn. Diagnostics only.

Source

pub fn remaining_tool_calls(&self) -> u32

Remaining tool-call allowance (for exact-cap batch splitting).

Source

pub fn charge_tool_calls(&mut self, n: u32)

Charge n executed tool calls (the caller split the batch against Self::remaining_tool_calls, so this never over-charges).

Source

pub fn charge_tool_result_bytes( &mut self, bytes: usize, ) -> Result<(), BudgetDimension>

Charge the bytes of one round’s tool results; exceeding the accumulated cap exhausts the ToolResultBytes dimension.

Source

pub fn check_usage( &self, usage: &UsageCounters, model: &str, ) -> Result<(), BudgetDimension>

Optional dimensions, consulted after each provider round from the shared usage counters. model feeds the pricing table for the cost estimate; both checks are no-ops when unconfigured.

Trait Implementations§

Source§

impl Debug for TurnBudgetMeter

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> Downcast for T
where T: Any,

Source§

fn into_any(self: Box<T>) -> Box<dyn Any>

Convert Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.
Source§

fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>

Convert Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be further downcast into Rc<ConcreteType> where ConcreteType implements Trait.
Source§

fn as_any(&self) -> &(dyn Any + 'static)

Convert &Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &Any’s vtable from &Trait’s.
Source§

fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)

Convert &mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &mut Any’s vtable from &mut Trait’s.
Source§

impl<T> DowncastSync for T
where T: Any + Send + Sync,

Source§

fn into_any_arc(self: Arc<T>) -> Arc<dyn Any + Send + Sync> ⓘ

Convert Arc<Trait> (where Trait: Downcast) to Arc<Any>. Arc<Any> can then be further downcast into Arc<ConcreteType> where ConcreteType implements Trait.
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<A, B, T> HttpServerConnExec<A, B> for T
where B: Body,

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more