Trait UsageHandler 

pub trait UsageHandler<CTXEXT> {
    // Required method
    fn handle_usage<'life0, 'async_trait>(
        &'life0 self,
        ctx: Context<CTXEXT>,
        request: Arc<VectorCompletionCreateParams>,
        response: VectorCompletion,
    ) -> Pin<Box<dyn Future<Output = ()> + Send + 'async_trait>>
       where Self: 'async_trait,
             'life0: 'async_trait;
}

Handles usage tracking after a vector completion completes.

Required Methods

fn handle_usage<'life0, 'async_trait>( &'life0 self, ctx: Context<CTXEXT>, request: Arc<VectorCompletionCreateParams>, response: VectorCompletion, ) -> Pin<Box<dyn Future<Output = ()> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Called after a vector completion finishes to track usage.

Implementors

impl<CTXEXT> UsageHandler<CTXEXT> for LogUsageHandler

where CTXEXT: Send + Sync + 'static,