Struct SetBatchIterator 

pub struct SetBatchIterator { /* private fields */ }

Iterator for scanning Redis sets in batches as Arrow RecordBatches.

This iterator fetches set keys matching a pattern and retrieves their members, converting them to Arrow RecordBatches for use with Polars. Each member becomes a row in the output.

Example

use polars_redis::{SetBatchIterator, SetSchema, BatchConfig};

let schema = SetSchema::new().with_key(true);
let config = BatchConfig::new("tags:*").with_batch_size(1000);

let mut iterator = SetBatchIterator::new(url, schema, config)?;

while let Some(batch) = iterator.next_batch()? {
    println!("Got {} members", batch.num_rows());
}

Output Schema

• _key (optional): The Redis key
• member: The set member value (Utf8)

Implementations

impl SetBatchIterator

pub fn new(url: &str, schema: SetSchema, config: BatchConfig) -> Result<Self>

Create a new SetBatchIterator.

pub fn next_batch(&mut self) -> Result<Option<RecordBatch>>

Get the next batch of data as a RecordBatch.

pub fn is_done(&self) -> bool

Check if iteration is complete.

pub fn rows_yielded(&self) -> usize

Get the number of rows (members) yielded so far.