Crate sharded_log

Crate sharded_log 

Source
Expand description

Shards batches of writes across multiple log files for high throughput and low contention. The general usage pattern is:

  1. recover, pass recovered data to downstream storage
  2. delete old logs
  3. begin writing to the sharded logs

Structsยง

Config
RecoveryIterator
Reservation
ShardedLog
Allows batches of bytes to be written with low contention, and read-back in a linearized order.