Struct Cache 

pub struct Cache { /* private fields */ }

Implementations

impl Cache

pub fn new(config: &Value, storage: Arc<dyn Storage>) -> Result<Self, String>

pub fn admin_routes(&self) -> Router

Trait Implementations

impl Extension for Cache

fn name(&self) -> &str

Human-readable name for this extension, used in logs and diagnostics.

fn prefix(&self) -> Prefix

Fixed 4-byte prefix that namespaces this extension’s storage keys.

fn on_cache_lookup(&self, raw_request: &[u8]) -> BoxFuture<'_, Option<Vec<u8>>>

Check for a cached response before provider dispatch. Return Some with raw response bytes to skip the provider call entirely. Called for non-streaming requests only.

fn on_response( &self, ctx: &RequestContext, raw_request: &[u8], raw_response: &[u8], ) -> BoxFuture<'_, ()>

Called after a non-streaming response arrives from the provider. Both request and response are raw wire bytes.

fn storage_key(&self, suffix: &[u8]) -> Vec<u8>

Build a full storage key by prepending this extension’s prefix to suffix.

fn on_request( &self, _ctx: &RequestContext, ) -> Pin<Box<dyn Future<Output = Result<(), ExtensionError>> + Send + '_>>

Called post-auth, pre-dispatch. Return Err to short-circuit the pipeline (no provider call, no further extensions run).

fn on_chunk( &self, _ctx: &RequestContext, _raw_chunk: &[u8], ) -> Pin<Box<dyn Future<Output = ()> + Send + '_>>

Called once per SSE chunk during a streaming response. raw_chunk is the serialized JSON of the chunk.

fn on_error( &self, _ctx: &RequestContext, _error: &Error, ) -> Pin<Box<dyn Future<Output = ()> + Send + '_>>

Called when the provider returns an error.