Struct lance_encoding::encodings::logical::struct::SimpleStructScheduler

pub struct SimpleStructScheduler { /* private fields */ }

A scheduler for structs

The implementation is actually a bit more tricky than one might initially think. We can’t just go through and schedule each column one after the other. This would mean our decode can’t start until nearly all the data has arrived (since we need data from each column)

Instead, we schedule in row-major fashion, described in detail below.

Note: this scheduler is the starting point for all decoding. This is because we treat the top-level record batch as a non-nullable struct.

Implementations

impl SimpleStructScheduler

pub fn new( children: Vec<Vec<Box<dyn LogicalPageScheduler>>>, child_fields: Fields ) -> Self

Trait Implementations

impl Debug for SimpleStructScheduler

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl LogicalPageScheduler for SimpleStructScheduler

fn schedule_ranges( &self, ranges: &[Range<u32>], scheduler: &Arc<dyn EncodingsIo>, sink: &UnboundedSender<Box<dyn LogicalPageDecoder>> ) -> Result<()>

Schedules I/O for the requested portions of the page.

fn num_rows(&self) -> u32

The number of rows covered by this page

fn schedule_take( &self, indices: &[u32], scheduler: &Arc<dyn EncodingsIo>, sink: &UnboundedSender<Box<dyn LogicalPageDecoder>> ) -> Result<()>

Schedules I/O for the requested rows (identified by row offsets from start of page) TODO: implement this using schedule_ranges