Expand description
Layout trees, layout readers, scan planning, and segment IO.
A Layout is the serialized, row-counted representation of an array tree. It records logical
dtype, child layout relationships, segment ids, and encoding metadata; it does not own the
segment bytes. A LayoutReader pairs a layout with a SegmentSource
and session so scans can evaluate projections and filters.
Most users enter this crate through file APIs, but extension authors implement VTable,
LayoutEncoding, and LayoutStrategy to add new on-disk organizations.
Scanning is built with scan::scan_builder::ScanBuilder. It accepts a projection expression,
optional filter, optional row range, Selection, split
strategy, and task concurrency settings, then produces array streams or iterators.
Re-exports§
pub use vtable::*;
Modules§
- aliases
- display
- layouts
- A collection of built-in layouts for Vortex
- scan
- segments
- Segment access abstractions for layouts.
- sequence
- session
- vtable
Macros§
Structs§
- Layout
Adapter - Layout
Encoding Adapter - Object-safe adapter from a typed layout
VTabletoLayoutEncoding. - Layout
Reader Context - Per-reader-tree dependency context, threaded through
crate::VTable::new_reader. - Lazy
Reader Children - Lazily constructs and caches child readers while preserving reader context.
- RowSplits
- A collection of root-coordinate row split points.
- Split
Range - A row range used when registering natural scan splits.
Enums§
- Layout
Child Type - A type that allows us to identify how a layout child relates to its parent.
Traits§
- Array
Future Ext - Helpers for futures that resolve to arrays.
- Into
Layout - Conversion into an erased
LayoutRef. - Layout
- Erased layout tree node.
- Layout
Children - Abstract way of accessing the children of a layout.
- Layout
Encoding - Object-safe layout encoding registered in a
LayoutSession. - Layout
Reader - Stateful reader for a
crate::Layout. - Layout
Strategy - Writes an ordered array stream into a layout tree and segment sink.
Functions§
- layout_
from_ flatbuffer - Parse a
LayoutReffrom a layout flatbuffer. - layout_
from_ flatbuffer_ with_ options - Parse a
LayoutReffrom a layout flatbuffer with unknown-encoding behavior control.
Type Aliases§
- Array
Future - Future resolving to a projected Vortex array.
- Layout
Context - Layout
Encoding Id - A unique identifier for a layout encoding.
- Layout
Encoding Ref - Shared reference to a registered layout encoding.
- Layout
Id - A unique identifier for a layout encoding.
- Layout
Reader Ref - Shared handle to a stateful layout reader.
- Layout
Ref - Shared, erased handle to a layout tree node.