Struct ApiResponseCache 

pub struct ApiResponseCache { /* private fields */ }

Thread-safe API response cache

Implementations

impl ApiResponseCache

pub fn new() -> Self

Create a new cache

pub fn get_or_compute<F>( &self, key: &str, ttl: Duration, compute_fn: F, ) -> Result<(Arc<[u8]>, String), String>

where F: FnOnce() -> Result<Vec<u8>, String>,

Get cached response or compute new one.

Optimized to return Arc<u8> instead of Vec to prevent cloning the entire response body (which can be multi-megabyte JSON) on cache hits. This reduces allocation churn and memory traffic from O(N) to O(1) time and space complexity. Further optimized using lock-free atomics for statistics tracking, preventing write lock contention on the hot path of cache hits/misses.

pub fn etag_matches(&self, key: &str, client_etag: &str) -> bool

Check if client’s ETag matches (for 304 responses)

pub fn record_etag_hit(&self)

Record ETag hit (304 response sent)

pub fn stats(&self) -> CacheStats

Get current cache statistics

pub fn clear(&self)

Clear all cache entries

pub fn pre_warm<F>( &self, endpoints: Vec<(&str, Duration)>, compute_fn: F, ) -> Result<(), String>

where F: Fn(&str) -> Result<Vec<u8>, String>,

Pre-warm cache with known endpoints

pub fn size(&self) -> usize

Get cache size (number of entries)

Trait Implementations

impl Clone for ApiResponseCache

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ApiResponseCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ApiResponseCache

fn default() -> Self

Returns the “default value” for a type.