Bitcoin Block Parser
Fast optimized parser for the bitcoin blocks
data with UTXO tracking.
Features
- Parses blocks into the Rust bitcoin
Block
format for easier manipulation - Tracks whether any
TxOut
in aTransaction
is spent or unspent - Tracks the
Amount
of everyTxIn
for calculating metrics such as fee rates - Uses memory-optimizations, multithreading, and filters to provide the best performance
Requirements / Benchmarks
- You must be running a non-pruning bitcoin node (this is the default configuration)
- You should look at the table below to understand how much RAM you need (tunable through
Options
) - We recommend using fast storage and a multithreaded CPU for best performance
Our benchmarks were run on NVMe storage with a 32-thread processor on 850,000 blocks:
Function | Time | Memory |
---|---|---|
DefaultParser | 5 min | 3.5 GB |
FilterParser | 17 min | 9.3 GB |
UtxoParser | 39 min | 17.5 GB |
Quick Usage
- To parse blocks pass in the
blocks
directory of your bitcoin node and call parse() - If your algorithm requires the blocks to be processed in-order use parse_ordered()
- For examples of how to write custom parsers see the blocks and utxos module docs
use *;
// Load all the block locations from the headers of the block files
let mut headers = parse?;
// Iterates over all the first 600k blocks
for block in DefaultParser.parse