Struct Budget 

pub struct Budget { /* private fields */ }

Implementations

impl Budget

pub fn new( config: &Value, storage: Arc<dyn Storage>, models: HashMap<String, ModelInfo>, ) -> Result<Self, String>

pub fn admin_routes(&self) -> Router

Trait Implementations

impl Extension for Budget

fn name(&self) -> &str

Human-readable name for this extension, used in logs and diagnostics.

fn prefix(&self) -> Prefix

Fixed 4-byte prefix that namespaces this extension’s storage keys.

fn on_request( &self, ctx: &RequestContext, ) -> BoxFuture<'_, Result<(), ExtensionError>>

Called post-auth, pre-dispatch. Return Err to short-circuit the pipeline (no provider call, no further extensions run).

fn on_response( &self, ctx: &RequestContext, _raw_request: &[u8], raw_response: &[u8], ) -> BoxFuture<'_, ()>

Called after a non-streaming response arrives from the provider. Both request and response are raw wire bytes.

fn on_chunk(&self, ctx: &RequestContext, raw_chunk: &[u8]) -> BoxFuture<'_, ()>

Called once per SSE chunk during a streaming response. raw_chunk is the serialized JSON of the chunk.

fn storage_key(&self, suffix: &[u8]) -> Vec<u8>

Build a full storage key by prepending this extension’s prefix to suffix.

fn on_cache_lookup( &self, _raw_request: &[u8], ) -> Pin<Box<dyn Future<Output = Option<Vec<u8>>> + Send + '_>>

Check for a cached response before provider dispatch. Return Some with raw response bytes to skip the provider call entirely. Called for non-streaming requests only.

fn on_error( &self, _ctx: &RequestContext, _error: &Error, ) -> Pin<Box<dyn Future<Output = ()> + Send + '_>>

Called when the provider returns an error.