Expand description
SQLite integration for the Synaptic framework.
This crate provides SqliteCache, a SQLite-backed implementation of the
LlmCache trait for caching LLM responses with
optional TTL expiration.
§Quick start
use synaptic_sqlite::{SqliteCache, SqliteCacheConfig};
// In-memory cache (great for testing)
let cache = SqliteCache::new(SqliteCacheConfig::in_memory())?;
// File-based cache with 1-hour TTL
let config = SqliteCacheConfig::new("/tmp/llm_cache.db").with_ttl(3600);
let cache = SqliteCache::new(config)?;Structs§
- Chat
Response - A response from a chat model containing the AI message and optional token usage statistics.
- Sqlite
Cache - SQLite-backed implementation of the
LlmCachetrait. - Sqlite
Cache Config - Configuration for
SqliteCache.
Traits§
- LlmCache
- Trait for caching LLM responses.