Skip to main content

DataFrameStreamExt

spark_connect::ext

Trait DataFrameStreamExt 

Source 
pub trait DataFrameStreamExt {
    // Required method
    fn to_local_iterator_async(&self, prefetch_partitions: bool) -> RowStream;
}
Expand description

Streams a DataFrame’s rows as the server produces them.

Required Methods§

Source

fn to_local_iterator_async(&self, prefetch_partitions: bool) -> RowStream

Async DataFrame::to_local_iterator.

Rows are fetched on tokio’s blocking thread pool and yielded as they arrive, holding at most one server batch plus a bounded row buffer in memory. Dropping the stream stops fetching.

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§