SparrowDB is an embedded graph database. It links directly into your process — Rust, Python, Node.js, or Ruby — and gives you a real Cypher query interface backed by a WAL-durable store on disk. No server. No JVM. No cloud subscription. No daemon to babysit.
If your data is fundamentally relational — recommendations, social graphs, dependency trees, fraud rings, knowledge graphs — and you want to query it with multi-hop traversals instead of JOIN chains, SparrowDB is the drop-in answer.
Quick Start
use GraphDb;
That's it. The database is a directory on disk. Ship it.
Performance: Faster Than Neo4j Where It Counts
Benchmarked against Neo4j 5.x on the SNAP Facebook dataset (4,039 nodes, 88,234 edges). All figures are p50 latency, v0.1.13.
| Query | SparrowDB | Neo4j | vs Neo4j |
|---|---|---|---|
| Point Lookup (indexed) | 103µs | 321µs | 3x faster |
| Global COUNT(*) | 2.2µs | 202µs | 93x faster |
| Top-10 by Degree | 401µs | 17,588µs | 44x faster |
| 1-Hop Traversal | 42.8ms | 632µs | 68x slower |
| 2-Hop Traversal | 83.7ms | 376µs | 222x slower |
Point lookups and aggregations beat a running Neo4j server — with no JVM, no server process, no network hop.
The traversal gap is real and documented (see Performance). SparrowDB is the right choice when you're building apps, not operating a graph cluster. Deep multi-hop on billion-edge social graphs is Neo4j's domain. Everything else — embedded apps, agents, CLIs, edge services, knowledge graphs — is SparrowDB's.
Cold start: ~27ms — viable for serverless and short-lived processes where Neo4j's server startup is disqualifying.
Built for AI Agents and MCP
SparrowDB ships with a first-class MCP server (sparrowdb-mcp) — the only embedded graph database with native MCP support. It speaks JSON-RPC 2.0 over stdio and plugs directly into Claude Desktop and any MCP-compatible AI client.
Add to ~/Library/Application Support/Claude/claude_desktop_config.json:
Your AI assistant can now query and write to your graph database using natural tool calls:
| Tool | Description |
|---|---|
execute_cypher |
Execute any Cypher statement; returns result rows |
create_entity |
Create a node with a label and properties |
add_property |
Set a property on nodes matching a filter |
checkpoint |
Flush WAL and compact |
info |
Database metadata |
Full setup: docs/mcp-setup.md
Why this matters for agent builders: Multi-agent systems need shared, persistent graph state. SparrowDB gives your agents a knowledge graph they can read and write without spinning up a server. Pair it with SparrowOntology for schema-enforced agent memory and governance.
Why SparrowDB
The graph database landscape has a gap.
Neo4j is powerful, but it requires a running server, a JVM, and a license the moment you need production features. DGraph is horizontally scalable, but you don't need horizontal scale — you need to ship your app. Every existing option assumes you want to operate a database cluster, not embed a graph engine.
SparrowDB fills the same role SQLite fills for relational data: zero infrastructure, full capability, open source, MIT licensed.
| Question | Answer |
|---|---|
| Does it need a server? | No. It's a library. |
| Does it need a cloud account? | No. It's a file on disk. |
Can it survive kill -9? |
Yes. WAL + crash recovery. |
| Can multiple threads read at once? | Yes. SWMR — readers never block writers. |
| Does the Python binding release the GIL? | Yes. Every call into the engine releases it. |
| Can I use it from an AI assistant? | Yes. Built-in MCP server. |
When to Use SparrowDB
SparrowDB is the right choice when:
- Your data has structure that's hard to flatten. Social follows, product recommendations, dependency graphs, org charts, bill-of-materials, knowledge graphs — these are terrible in SQL and natural in graphs.
- You're building an application, not operating a database. You want to
cargo add sparrowdband ship, not provision instances. - You need multi-hop queries.
MATCH (a)-[:FOLLOWS*1..3]->(b)is one query. In SQL it's recursive CTEs all the way down. - You're embedding into a CLI, desktop app, agent, or edge service. SparrowDB opens in milliseconds and has no runtime overhead when idle.
SparrowDB is not the right choice when:
- Deep multi-hop traversal is your primary workload. 1-hop to 5-hop queries on high-fanout graphs (social networks, web graphs) are where Neo4j's battle-hardened CSR layout and parallel execution show. SparrowDB is currently 68x–435x behind on those queries (1-hop: 68x, 2-hop: 222x, mutual friends: 435x). That gap is actively narrowing (see Roadmap), but if deep traversal is your core workload today, use Neo4j.
- You need distributed writes across many nodes, or your graph has billions of edges and requires horizontal sharding. Use Neo4j Aura or DGraph for that.
Install
Node.js
Rust
[]
= "0.1"
Python
# Build from source (requires Rust toolchain):
&&
PyPI package coming soon. Pre-built wheels are on the roadmap.
Ruby
# Build from source (requires Rust toolchain):
&& &&
RubyGems package coming soon.
CLI
MCP Server (Claude Desktop integration)
Features
Cypher Support
| Feature | Status |
|---|---|
CREATE, MATCH, SET, DELETE |
✅ |
WHERE — =, <>, <, <=, >, >= |
✅ |
WHERE n.prop CONTAINS str / STARTS WITH str |
✅ |
WHERE n.prop IS NULL / IS NOT NULL |
✅ |
1-hop and multi-hop edges (a)-[:R]->()-[:R]->(c) |
✅ |
Undirected edges (a)-[:R]-(b) |
✅ |
Reverse-arrow pattern (a)->()<-(c) |
✅ |
Variable-length paths [:R*1..N] |
✅ |
Multi-label nodes (n:A:B) |
✅ |
RETURN DISTINCT, ORDER BY, LIMIT, SKIP |
✅ |
COUNT(*), COUNT(expr), COUNT(DISTINCT expr) |
✅ |
SUM, AVG, MIN, MAX |
✅ |
collect() — aggregate into list |
✅ |
coalesce(expr1, expr2, …) — first non-null |
✅ |
WITH … WHERE pipeline (filter mid-query) |
✅ |
WITH … MATCH pipeline (chain traversals) |
✅ |
WITH … UNWIND pipeline |
✅ |
UNWIND list AS var MATCH (n {id: var}) |
✅ |
OPTIONAL MATCH |
✅ |
UNION / UNION ALL |
✅ |
MERGE — upsert node with ON CREATE SET / ON MATCH SET |
✅ |
MATCH (a),(b) MERGE (a)-[:R]->(b) — idempotent edge |
✅ |
CREATE (a)-[:REL]->(b) — directed edge |
✅ |
CASE WHEN … THEN … ELSE … END |
✅ |
EXISTS { (n)-[:REL]->(:Label) } |
✅ |
EXISTS in WITH … WHERE |
✅ |
shortestPath((a)-[:R*]->(b)) |
✅ |
ANY / ALL / NONE / SINGLE list predicates |
✅ |
id(n), labels(n), type(r) |
✅ |
size(), range(), toInteger(), toString() |
✅ |
toUpper(), toLower(), trim(), replace(), substring() |
✅ |
abs(), ceil(), floor(), sqrt(), sign() |
✅ |
Parameters $param |
✅ |
CALL db.index.fulltext.queryNodes — scored full-text search |
✅ |
CALL db.schema() |
✅ |
Subqueries CALL { … } |
⚠️ Partial |
Engine & Storage
- WAL durability — write-ahead log with crash recovery; survives hard kills
- SWMR concurrency — single-writer, multiple-reader; readers never block writers
- Chunked vectorized pipeline — 4-phase chunked execution engine for multi-hop traversals; FrontierScratch arena eliminates per-hop allocation; SlotIntersect for mutual-neighbor queries
- Factorized execution — multi-hop traversals avoid materializing O(N²) intermediate rows
- B-tree property index — equality lookups in O(log n), not full label scans; persisted to disk
- Inverted text index —
CONTAINS/STARTS WITHrouted through an index - Full-text search — relevance-scored
queryNodeswithout Elasticsearch - External merge sort —
ORDER BYon large results spills to disk; no unbounded heap - At-rest encryption — optional XChaCha20-Poly1305 per WAL entry; wrong key errors immediately, never silently decrypts garbage
execute_batch()— multiple writes in onefsyncfor bulk-load throughput- Bulk CSV loader —
sparrowdb bulk-importingests node and edge CSVs with batched WriteTx for high-throughput imports execute_with_timeout()— cancel runaway traversals without killing the processexport_dot()— export any graph to Graphviz DOT for visualization- APOC CSV import — migrate existing Neo4j graphs in one command
- MVCC write-write conflict detection — two writers on the same node: the second is aborted
Language Bindings
| Language | Mechanism | Status |
|---|---|---|
| Rust | Native GraphDb API |
✅ Stable |
| Python | PyO3 — releases GIL, context manager | ✅ Stable |
| Node.js | napi-rs — SparrowDB class |
✅ Stable |
| Ruby | Magnus extension | ✅ Stable |
All bindings open the same on-disk format. A graph written from Python can be read by Node.js.
Language Examples
Rust
use GraphDb;
use Duration;
Python
# Context manager — database closes cleanly on exit; execute() releases the GIL
=
# Thread-safe: GIL is released inside execute()
return
=
Node.js / TypeScript
import SparrowDB from 'sparrowdb';
const db = new SparrowDB('/path/to/my.db');
db.execute("CREATE (n:Article {id: 'a1', title: 'Graph Databases 101', tags: 'graphs,rust'})");
db.execute("CREATE (n:Article {id: 'a2', title: 'Cypher Query Language', tags: 'cypher,graphs'})");
db.execute("MATCH (a:Article {id:'a1'}),(b:Article {id:'a2'}) CREATE (a)-[:RELATED]->(b)");
// Full-text search
db.execute("CALL db.index.fulltext.createNodeIndex('articles', ['Article'], ['title', 'tags'])");
const results = db.execute(
"CALL db.index.fulltext.queryNodes('articles', 'rust') " +
"YIELD node, score RETURN node.title, score ORDER BY score DESC"
);
db.close();
Ruby
db = SparrowDB::GraphDb.new()
db.execute()
db.execute()
db.execute()
rows = db.execute(
)
puts rows.inspect # [["serde"]]
db.close
Real-World Use Cases
Recommendation Engine
MATCH (u:User {id: $user_id})-[:LIKED]->(item:Item)
WITH collect(item) AS liked_items
MATCH (other:User)-[:LIKED]->(item) WHERE item IN liked_items
WITH other, COUNT(item) AS overlap ORDER BY overlap DESC LIMIT 20
MATCH (other)-[:LIKED]->(candidate:Item)
WHERE NOT candidate IN liked_items
RETURN candidate.name, COUNT(other) AS score ORDER BY score DESC LIMIT 10
Fraud Detection
MATCH (flagged:Account {status:'fraudulent'})-[:USED]->(device:Device)
MATCH (device)<-[:USED]-(suspect:Account)
WHERE suspect.status <> 'fraudulent'
WITH suspect, COUNT(device) AS shared_devices
WHERE shared_devices >= 2
RETURN suspect.id, suspect.email, shared_devices
ORDER BY shared_devices DESC
Dependency Graph
-- What breaks if we remove this package?
MATCH (pkg:Package {name: $package_name})<-[:DEPENDS_ON*1..10]-(dependent)
RETURN DISTINCT dependent.name, dependent.version
ORDER BY dependent.name
Knowledge Graph
MATCH (a:Concept {name: 'machine learning'}), (b:Concept {name: 'linear algebra'})
MATCH path = shortestPath((a)-[:RELATED_TO|REQUIRES|FOUNDATION_OF*]->(b))
RETURN [n IN nodes(path) | n.name] AS connection_chain
Org Chart Reporting
MATCH (emp:Employee {name: $name})-[:REPORTS_TO*]->(mgr:Employee)
RETURN emp.name, [m IN collect(mgr) | m.name + ' (' + m.title + ')'] AS chain
Advanced Features
Encrypted Database
use GraphDb;
Graph Visualization
|
Full-Text Search
db.execute?;
db.execute?;
let results = db.execute?;
Per-Query Timeout
match db.execute_with_timeout
Bulk CSV Import
# High-throughput node + edge ingestion via CLI
// Or from Rust
use ;
let loader = new;
let n = loader.load_nodes?;
let e = loader.load_edges?;
Neo4j Migration
# Export from Neo4j using APOC, then:
Performance Characteristics
Benchmark Results: SNAP Facebook Dataset (v0.1.13)
Measured against Neo4j 5.x (server, JVM warmed) and Kùzu (Shi et al. VLDB 2023). All figures are p50 latency in microseconds. Dataset: SNAP Facebook social graph (4,039 nodes, 88,234 edges), 50 warmup + 200 iterations.
| Query | SparrowDB (µs) | Neo4j (µs) | Kùzu (µs) | vs Neo4j |
|---|---|---|---|---|
| Q1 Point Lookup (indexed) | 103 | 321 | 280 | 3x faster |
| Q2 Range Filter | 3,600 | 333 | n/a | 11x slower |
| Q3 1-Hop Traversal | 42,800 | 632 | 410 | 68x slower |
| Q4 2-Hop Traversal | 83,700 | 376 | 490 | 222x slower |
| Q5 Variable Path 1..3 | 12,100 | 501 | 620 | 24x slower |
| Q6 Global COUNT(*) | 2.2 | 202 | 150 | 93x faster |
| Q7 Top-10 by Degree | 401 | 17,588 | n/a | 44x faster |
| Q8 Mutual Friends | 153,300 | 352 | n/a | 435x slower |
Neo4j reference: measured locally, Neo4j Docker v5.x, Bolt TCP. Kùzu reference: Shi et al. VLDB 2023 Table 5, in-process.
Where SparrowDB wins:
- Q1 (point lookup): B-tree property index at 103µs — 3x faster than Neo4j's Bolt round-trip with JVM overhead.
- Q6 (global COUNT): 2.2µs — 93x faster. Catalog-level metadata lookup, no scan.
- Q7 (top-10 by degree): 401µs — 44x faster than Neo4j's 17.6ms. Pre-computed degree cache vs Neo4j's full adjacency scan.
- Cold start: ~27ms on macOS SSD — viable for serverless and short-lived CLI processes.
Where SparrowDB trails: Multi-hop traversal (Q3, Q4, Q5, Q8) and range scans (Q2). The gap is actively narrowing — Q4 improved 7% and Q8 p99 dropped 37% in v0.1.13 — but the remaining gap is structural: the execution engine is single-threaded and the CSR layout isn't yet fully exploited for in-memory traversal walks. See Roadmap.
What this means in practice:
- Use SparrowDB for: embedded apps, CLIs, agents, edge services, recommendation engines, and workloads dominated by point lookups, writes, aggregations, and shallow traversals.
- Use Neo4j for: deep multi-hop traversal on large social or web graphs as the primary query pattern.
Engine Design
| Technique | What it buys you |
|---|---|
| Chunked vectorized pipeline | 4-phase execution: ScanByLabel → GetNeighbors chunks → SlotIntersect → ReadNodeProps; eliminates per-row allocation overhead |
| FrontierScratch arena | Reusable flat arena for BFS frontiers; no per-hop heap allocation |
| Factorized execution | Multi-hop traversals avoid materializing O(N²) intermediate rows |
| B-tree property index | Equality lookups: O(log n), not a full label scan; persisted across restarts |
| Inverted text index | CONTAINS / STARTS WITH without scanning every node |
| External merge sort | ORDER BY on results larger than RAM — sorted runs spill to disk |
execute_batch() |
Bulk loads committed in one fsync |
| SWMR concurrency | Concurrent readers at zero extra cost; readers never block writers |
| Zero-copy open | Opens in under 1ms — suitable for serverless and short-lived processes |
| GIL-released Python | Python threads can issue parallel reads without contention |
Comparison
| SparrowDB | Neo4j | DGraph | SQLite + JSON | |
|---|---|---|---|---|
| Deployment | Embedded (in-process) | Server required | Server required | Embedded |
| Query language | Cypher | Cypher | GraphQL+DQL | SQL |
| Primary language | Rust | JVM | Go | C |
| Python binding | PyO3 native (releases GIL) | Bolt driver | Bolt driver | Adapter |
| Node.js binding | napi-rs native | Bolt driver | Bolt driver | Adapter |
| Ruby binding | Magnus native | Bolt driver | None | Adapter |
| At-rest encryption | XChaCha20 built-in | Enterprise only | No | No |
| WAL crash recovery | Yes | Yes | Yes | Yes |
| Full-text search | Built-in | Built-in | Built-in | No |
| MCP server | Built-in | No | No | No |
| Bulk CSV import | Built-in | Via neo4j-admin | Via bulk loader | No |
| License | MIT | GPL / Commercial | Apache 2 | Public domain |
| Runtime dependencies | Zero | JVM + server | Server process | Zero |
TL;DR: If you need embedded + Cypher + zero infrastructure, there's nothing else. SparrowDB is the only option in that row.
CLI Reference
|
# NDJSON server mode
# stdin: {"id":"q1","cypher":"MATCH (n) RETURN n LIMIT 5"}
# stdout: {"id":"q1","columns":["n"],"rows":[...],"error":null}
Project Status
SparrowDB is pre-1.0. We are building in public.
The API is stable enough to build on, but the on-disk format may change before 1.0. Pin your version.
What's done: Full Cypher subset · Multi-label nodes (n:A:B) · WAL durability + crash recovery · MVCC · At-rest encryption · 4-phase chunked vectorized pipeline · Factorized multi-hop engine · B-tree + full-text indexes · External merge sort · Per-query timeouts · Bulk CSV loader · Python / Node.js / Ruby bindings · MCP server · CLI tools · Neo4j APOC import
Roadmap
| Issue | Work | Why it matters |
|---|---|---|
| #300 | Flat BFS arena — replace FrontierScratch with a single flat arena | Eliminates remaining allocation churn in Q8 mutual-neighbor traversals |
| #248 | WHERE predicate on edge properties returns 0 rows | Blocks rating/weight-based queries |
| SPA-253 | WAL CRC32C integrity checksums | Required before 1.0 |
| SPA-231 | HTTP/SSE transport layer | Remote access without embedding |
| — | PyPI pre-built wheels | No Rust toolchain required for Python users |
| — | RubyGems package | No Rust toolchain required for Ruby users |
Recently shipped:
- 4-phase chunked vectorized pipeline (#299) — FrontierScratch arena + SlotIntersect; Q4 −7%, Q8 p99 −37% in v0.1.13
- Multi-label nodes
(n:A:B)(#289) — standard Cypher multi-label semantics - Bulk CSV loader (#296) —
sparrowdb bulk-importfor high-throughput node/edge ingestion - Reverse-arrow pattern fix (#294) —
(a)->()<-(c)now returns correct results - B-tree property index persisted to disk (#286) — index survives restart; no re-build on open
- Delta log O(1) index (#283) — un-checkpointed writes no longer degrade traversal
- Degree cache — Q7 (Top-10 Degree): 1,279ms → 401µs, now 44x faster than Neo4j
- B-tree property index — Q1 (Point Lookup): ~444µs → 103µs, now 3x faster than Neo4j
- Global COUNT optimization — Q6: 24µs → 2.2µs, now 93x faster than Neo4j
- 2-hop aggregate fix (#282) — COUNT(*) on multi-hop queries no longer returns null
Architecture
+------------------------------------------------------------------------+
| Language Bindings |
| Rust - Python (PyO3) - Node.js (napi-rs) - Ruby (Magnus) |
| CLI (sparrowdb) - MCP Server (sparrowdb-mcp) |
+------------------------------------------------------------------------+
| Cypher Frontend (sparrowdb-cypher) |
| Lexer -> AST -> Binder (name resolution, type checking) |
+------------------------------------------------------------------------+
| Execution Engine (sparrowdb-execution) |
| Chunked vectorized pipeline - ChunkedPlan selector |
| FrontierScratch arena - SlotIntersect - factorized aggregation |
| External merge sort - EXISTS evaluation - deadline checks |
+------------------------------------------------------------------------+
| Catalog (sparrowdb-catalog) |
| Label registry - B-tree property index - Inverted text index |
+------------------------------------------------------------------------+
| Storage (sparrowdb-storage) |
| Write-Ahead Log - CSR adjacency store - Delta log index |
| XChaCha20-Poly1305 encryption (optional) - Crash recovery - SWMR |
+------------------------------------------------------------------------+
| Crate | Role |
|---|---|
sparrowdb |
Public API — GraphDb, QueryResult, Value, BulkLoader |
sparrowdb-common |
Shared types and error definitions |
sparrowdb-storage |
WAL, CSR store, encryption, crash recovery |
sparrowdb-catalog |
Label/property schema, B-tree index, text index |
sparrowdb-cypher |
Lexer, parser, AST, binder |
sparrowdb-execution |
Chunked vectorized pipeline, sort, aggregation |
sparrowdb-cli |
sparrowdb command-line binary |
sparrowdb-mcp |
JSON-RPC 2.0 MCP server binary |
sparrowdb-python |
PyO3 extension module |
sparrowdb-node |
napi-rs Node.js addon |
sparrowdb-ruby |
Magnus Ruby extension |
Documentation
| Guide | |
|---|---|
| docs/quickstart.md | Build your first graph from zero |
| docs/cypher-reference.md | Full Cypher support with examples |
| docs/bindings.md | Rust, Python, Node.js, Ruby API details |
| docs/mcp-setup.md | MCP server and Claude Desktop config |
| docs/use-cases.md | Real-world usage patterns |
| DEVELOPMENT.md | Contributor workflow and architecture |
Contributing
Open an issue before submitting a large PR so we can discuss the design first.
License
MIT — see LICENSE.