Struct HanaBatchProcessor 

pub struct HanaBatchProcessor { /* private fields */ }

Processor that converts HANA rows into Arrow RecordBatches.

Buffers rows until batch_size is reached, then emits a RecordBatch. Implements the BatchProcessor trait with GAT support.

Example

use hdbconnect_arrow::conversion::HanaBatchProcessor;
use hdbconnect_arrow::traits::streaming::BatchConfig;

let schema = /* Arrow schema */;
let config = BatchConfig::with_batch_size(10000);
let mut processor = HanaBatchProcessor::new(Arc::new(schema), config);

for row in result_set {
    if let Some(batch) = processor.process_row(row)? {
        // Process batch
    }
}

// Don't forget to flush remaining rows
if let Some(batch) = processor.flush()? {
    // Process final batch
}

Implementations

impl HanaBatchProcessor

pub fn new(schema: SchemaRef, config: BatchConfig) -> Self

Create a new batch processor.

Arguments

• schema - Arrow schema for the batches
• config - Batch processing configuration

pub fn with_defaults(schema: SchemaRef) -> Self

Create with default configuration.

pub fn process_row(&mut self, row: &Row) -> Result<Option<RecordBatch>>

Process a single row.

Returns Ok(Some(batch)) when a batch is ready, Ok(None) when more rows are needed to fill a batch.

Errors

Returns error if value conversion fails or schema mismatches.

pub fn flush(&mut self) -> Result<Option<RecordBatch>>

Flush any remaining rows as a final batch.

Errors

Returns error if RecordBatch creation fails.

pub fn schema(&self) -> SchemaRef

Returns the schema of batches produced by this processor.

pub const fn buffered_rows(&self) -> usize

Returns the current row count in the buffer.

Trait Implementations

impl Debug for HanaBatchProcessor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.