Module key

Module key 

Source
Expand description

Cache key generation using SHA-256 hashing

This module provides efficient cache key generation from LLM prompts and parameters. Uses SHA-256 for consistent, collision-resistant hashing.

Structs§

CacheableRequest
Represents a cacheable LLM request

Functions§

generate_cache_key
Generate a cache key from a request using SHA-256
generate_short_key
Generate a short cache key (first 16 characters of the full hash) Useful for logging and debugging