Module decoder

Module containing helper methods for the various file formats See write.rs for write related helper methods

Structs

DecoderDeserializer

A generic, decoder-based deserialization scheme for processing encoded data.

Enums

DeserializerOutput

Possible outputs of a BatchDeserializer.

Traits

BatchDeserializer

Trait defining a scheme for deserializing byte streams into structured data. Implementors of this trait are responsible for converting raw bytes into RecordBatch objects.

Decoder

A general interface for decoders such as arrow::json::reader::Decoder and arrow::csv::reader::Decoder. Defines an interface similar to Decoder::decode and Decoder::flush methods, but also includes a method to check if the decoder can flush early. Intended to be used in conjunction with DecoderDeserializer.

Functions

deserialize_stream

Deserializes a stream of bytes into a stream of RecordBatch objects using the provided deserializer.