Struct MemDriver 

pub struct MemDriver<T: Processable> { /* private fields */ }

The core driver between the block stream and MST walker

In the future, PDSs will export CARs in a stream-friendly order that will enable processing them with tiny memory overhead. But that future is not here yet.

CARs are almost always in a stream-unfriendly order, so I’m reverting the optimistic stream features: we load all block first, then walk the MST.

This makes things much simpler: we only need to worry about spilling to disk in one place, and we always have a reasonable expecatation about how much work the init function will do. We can drop the CAR reader before walking, so the sync/async boundaries become a little easier to work around.

Implementations

impl<T: Processable> MemDriver<T>

pub async fn next_chunk( &mut self, n: usize, ) -> Result<Option<BlockChunk<T>>, DriveError>

Step through the record outputs, in rkey order

Trait Implementations

impl<T: Debug + Processable> Debug for MemDriver<T>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.