Expand description
SQLite integration for the Synaptic framework.
This crate provides:
SqliteCache: A SQLite-backed implementation of theLlmCachetrait for caching LLM responses with optional TTL expiration.SqliteCheckpointer: A SQLite-backed implementation of theCheckpointertrait for persisting graph state between executions.
§Quick start
use synaptic_sqlite::{SqliteCache, SqliteCacheConfig};
// In-memory cache (great for testing)
let cache = SqliteCache::new(SqliteCacheConfig::in_memory())?;
// File-based cache with 1-hour TTL
let config = SqliteCacheConfig::new("/tmp/llm_cache.db").with_ttl(3600);
let cache = SqliteCache::new(config)?;Re-exports§
pub use checkpointer::SqliteCheckpointer;
Modules§
Structs§
- Chat
Response - A response from a chat model containing the AI message and optional token usage statistics.
- Sqlite
Cache - SQLite-backed implementation of the
LlmCachetrait. - Sqlite
Cache Config - Configuration for
SqliteCache.
Traits§
- Checkpointer
- Trait for persisting graph state checkpoints.
- LlmCache
- Trait for caching LLM responses.