Skip to main content

compute_cache_key

Function compute_cache_key 

Source
pub fn compute_cache_key(
    model: &str,
    system: Option<&str>,
    messages: &[&str],
) -> u64
Expand description

Compute a cache key from the request components that determine the response. Uses a fast non-cryptographic hash (FxHash-style) for performance.