pub struct RequestLogger;Implementations§
Trait Implementations§
Source§impl Extension for RequestLogger
impl Extension for RequestLogger
Source§fn on_response(
&self,
ctx: &RequestContext,
_request: &ChatCompletionRequest,
response: &ChatCompletionResponse,
) -> BoxFuture<'_, ()>
fn on_response( &self, ctx: &RequestContext, _request: &ChatCompletionRequest, response: &ChatCompletionResponse, ) -> BoxFuture<'_, ()>
Called after a non-streaming chat completion response arrives from the provider.
Source§fn on_error(&self, ctx: &RequestContext, error: &Error) -> BoxFuture<'_, ()>
fn on_error(&self, ctx: &RequestContext, error: &Error) -> BoxFuture<'_, ()>
Called when the provider returns an error.
Source§fn storage_key(&self, suffix: &[u8]) -> Vec<u8> ⓘ
fn storage_key(&self, suffix: &[u8]) -> Vec<u8> ⓘ
Build a full storage key by prepending this extension’s prefix to
suffix.Source§fn on_cache_lookup(
&self,
_request: &ChatCompletionRequest,
) -> Pin<Box<dyn Future<Output = Option<ChatCompletionResponse>> + Send + '_>>
fn on_cache_lookup( &self, _request: &ChatCompletionRequest, ) -> Pin<Box<dyn Future<Output = Option<ChatCompletionResponse>> + Send + '_>>
Check for a cached response before provider dispatch. Return
Some to
skip the provider call entirely. Called for non-streaming requests only.Source§fn on_request(
&self,
_ctx: &RequestContext,
) -> Pin<Box<dyn Future<Output = Result<(), ExtensionError>> + Send + '_>>
fn on_request( &self, _ctx: &RequestContext, ) -> Pin<Box<dyn Future<Output = Result<(), ExtensionError>> + Send + '_>>
Called post-auth, pre-dispatch. Return
Err to short-circuit the pipeline
(no provider call, no further extensions run).Source§fn on_chunk(
&self,
_ctx: &RequestContext,
_chunk: &ChatCompletionChunk,
) -> Pin<Box<dyn Future<Output = ()> + Send + '_>>
fn on_chunk( &self, _ctx: &RequestContext, _chunk: &ChatCompletionChunk, ) -> Pin<Box<dyn Future<Output = ()> + Send + '_>>
Called once per SSE chunk during a streaming response, before serialization.
Auto Trait Implementations§
impl Freeze for RequestLogger
impl RefUnwindSafe for RequestLogger
impl Send for RequestLogger
impl Sync for RequestLogger
impl Unpin for RequestLogger
impl UnsafeUnpin for RequestLogger
impl UnwindSafe for RequestLogger
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more