Trait BatchProcessor 

pub trait BatchProcessor {
    type Config;
    type Error: Error;
    type Batch<'a>
       where Self: 'a;

    // Required methods
    fn new(config: Self::Config, schema: SchemaRef) -> Self;
    fn process<'a>(
        &'a mut self,
        rows: &[Row],
    ) -> Result<Self::Batch<'a>, Self::Error>;
    fn flush(&mut self) -> Result<Option<RecordBatch>, Self::Error>;
}

A batch processor that transforms input rows into Arrow RecordBatches.

Uses GATs to allow flexible lifetime relationships between the processor and the batches it produces.

Required Associated Types

type Config

Configuration type for this processor.

type Error: Error

Error type produced by this processor.

type Batch<'a> where Self: 'a

The batch type produced, which may borrow from the processor.

Required Methods

fn new(config: Self::Config, schema: SchemaRef) -> Self

Create a new processor with the given configuration.

fn process<'a>( &'a mut self, rows: &[Row], ) -> Result<Self::Batch<'a>, Self::Error>

Process a chunk of rows into a batch.

Errors

Returns an error if processing fails.

fn flush(&mut self) -> Result<Option<RecordBatch>, Self::Error>

Flush any buffered data and return the final batch.

Errors

Returns an error if flushing fails.

Dyn Compatibility

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors