Skip to main content

Crate rypipe_core

Crate rypipe_core 

Source
Expand description

rypipe-core: format-agnostic columnar engine.

The crate parses byte streams into typed Arrow record batches through a small decoder API (Splitter + RecordParser + ColumnarSink). It has no format-specific logic and no Python/FFI dependencies.

Re-exports§

pub use arrow_export::apply_compare_filter;
pub use bounded::MemoryBudget;
pub use decoder::ColumnarSink;
pub use decoder::RecordParser;
pub use decoder::Splitter;
pub use engine::TableBuilder;
pub use error::Error;
pub use error::Result;
pub use input::InputBuffer;
pub use merge::engines_to_record_batches;
pub use pipeline::Pipeline;
pub use plan::CompareOp;
pub use plan::ExecutionPlan;
pub use plan::FieldType;
pub use plan::FilterPredicate;
pub use value::Value;

Modules§

arrow_export
bounded
columnar
decoder
engine
error
input
merge
parallel
pipeline
High-level, ergonomic API for running a Splitter + RecordParser pair.
plan
value