Struct UsageTracker 

pub struct UsageTracker { /* private fields */ }

Implementations

impl UsageTracker

pub fn new(_config: &Value, storage: Arc<dyn Storage>) -> Result<Self, String>

pub fn admin_routes(&self) -> Router

Admin usage routes: GET /v1/admin/usage?name=&model= — global view.

Trait Implementations

impl Extension for UsageTracker

fn name(&self) -> &str

Human-readable name for this extension, used in logs and diagnostics.

fn prefix(&self) -> Prefix

Fixed 4-byte prefix that namespaces this extension’s storage keys.

fn on_response( &self, ctx: &RequestContext, _raw_request: &[u8], raw_response: &[u8], ) -> BoxFuture<'_, ()>

Called after a non-streaming response arrives from the provider. Both request and response are raw wire bytes.

fn on_chunk(&self, ctx: &RequestContext, raw_chunk: &[u8]) -> BoxFuture<'_, ()>

Called once per SSE chunk during a streaming response. raw_chunk is the serialized JSON of the chunk.

fn storage_key(&self, suffix: &[u8]) -> Vec<u8>

Build a full storage key by prepending this extension’s prefix to suffix.

fn on_cache_lookup( &self, _raw_request: &[u8], ) -> Pin<Box<dyn Future<Output = Option<Vec<u8>>> + Send + '_>>

Check for a cached response before provider dispatch. Return Some with raw response bytes to skip the provider call entirely. Called for non-streaming requests only.

fn on_request( &self, _ctx: &RequestContext, ) -> Pin<Box<dyn Future<Output = Result<(), ExtensionError>> + Send + '_>>

Called post-auth, pre-dispatch. Return Err to short-circuit the pipeline (no provider call, no further extensions run).

fn on_error( &self, _ctx: &RequestContext, _error: &Error, ) -> Pin<Box<dyn Future<Output = ()> + Send + '_>>

Called when the provider returns an error.