semantic-memory

Hybrid semantic search with SQLite — BM25 + vector + Reciprocal Rank Fusion. Built for AI agents, runs everywhere from ESP32 to servers.

Features

• Hybrid search: BM25 (FTS5) + dense vectors (HNSW or brute-force) + RRF fusion
• PerDim compressed scoring (default): 4× compression, 100% recall@10, 205ms artifact generation
• Multi-codec dispatch: Runtime-switchable backends — Disabled, PerDim, TurboQuant, FibQuant
• Digest-verified artifact pipeline: SQLite generations with blake3 integrity
• Feature-gated compile: Zero-cost when disabled — per-dim-codec, fib-quant-codec, turbo-quant-codec
• no_std compatible (via compressed-scorer): Runs on ESP32-S3 microcontrollers

Quick start

[dependencies]
semantic-memory = { version = "0.6", features = ["per-dim-codec"] }

use semantic_memory::{MemoryStore, SearchConfig, DerivedVectorBackendPolicy};

// Default: PerDim compressed with exact rerank (100% recall)
let config = SearchConfig::default();

// Fast path: skip exact rerank (~1.2× faster, ~1% recall loss)
let mut config = SearchConfig::default();
config.per_dim_require_exact_rerank = false;

// Fall back to brute force exact search
config.derived_vector_backend = DerivedVectorBackendPolicy::Disabled;

Multi-codec dispatch

Performance

Benchmarked on AMD Ryzen 7 7730U, 1,865 vectors, 768-dim all-MiniLM-L6-v2 embeddings:

• Artifact generation: 205ms for full corpus
• PerDim exact rerank: 17.8 ms/query, 100% recall@10
• PerDim skip-rerank: 15.0 ms/query, 100% recall@10 (1.19× speedup)
• Space savings: 5.73MB → 1.44MB (3.98×)

Council Graph usage

semantic-memory is developed with Agent Graph council deliberation:

┌─ Coordinator ────────────────────────────────────┐
│  → Fanout → Analyst 0 (research)                  │
│          → Analyst 1 (implementation)             │
│          → Analyst 2 (validation)                 │
│  → Join → Synthesize → Plan                       │
└───────────────────────────────────────────────────┘

Multi-perspective research, spec generation, and implementation planning use the council_deliberation template. See RecursiveIntell doctrine for the full workflow.

Feature flags

License

Apache-2.0