Skip to main content

inspect_prompt_cache

Function inspect_prompt_cache 

Source
pub fn inspect_prompt_cache(
    directory: impl AsRef<Path>,
) -> Result<PromptCacheManifest, PromptCachePersistenceError>
Expand description

Reads and validates a prompt-cache manifest without loading tensor arrays.