Skip to main content

Crate copybook_arrow

Crate copybook_arrow 

Source
Expand description

Typed Arrow and Parquet output for copybook-rs

Converts COBOL binary data directly to Apache Arrow columnar format, preserving COBOL type precision (Decimal128 for COMP-3/Zoned, proper int widths, etc.)

Re-exports§

pub use batch_builder::RecordBatchBuilder;
pub use ipc::write_ipc;
pub use options::ArrowOptions;
pub use options::Compression;
pub use options::EditedPicRepresentation;
pub use parquet_writer::write_parquet;
pub use schema_convert::cobol_schema_to_arrow;
pub use streaming::stream_to_batches;
pub use legacy::LegacyArrowWriter as ArrowWriter;Deprecated
pub use legacy::LegacyParquetFileWriter as ParquetFileWriter;Deprecated
pub use legacy::json_to_record_batch;Deprecated
pub use legacy::json_to_schema;Deprecated

Modules§

batch_builder
Columnar RecordBatch construction from decoded COBOL records. RecordBatch builder that accumulates records and flushes Arrow batches
builders
Per-column accumulator trait and typed column builders. Column accumulator implementations for building Arrow arrays from raw COBOL data.
decode_direct
Direct binary → Arrow decoding (bypasses JSON intermediate). Direct record-to-column decoding without JSON intermediate representation
ipc
Arrow IPC (Feather) file writer. Arrow IPC (Feather v2) file writer
legacy
Legacy JSONL-to-Arrow API (deprecated; prefer decode_direct). Legacy JSON-based Arrow/Parquet conversion (deprecated)
options
Arrow/Parquet output configuration (compression, edited-PIC handling). Configuration options for Arrow/Parquet output
parquet_writer
Apache Parquet file writer with configurable compression. Parquet file writer with configurable compression and metadata embedding
schema_convert
COBOL schema → Arrow schema conversion (type mapping). COBOL schema to Arrow schema conversion
streaming
Streaming record-by-record Arrow output for large files. Streaming record reader that produces Arrow RecordBatch objects

Enums§

ArrowError
Errors that can occur during Arrow/Parquet conversion

Type Aliases§

Result
Result type for Arrow operations