Struct datafusion::datasource::file_format::parquet::ParquetSink
source · pub struct ParquetSink { /* private fields */ }
Expand description
Implements DataSink
for writing to a parquet file.
Implementations§
source§impl ParquetSink
impl ParquetSink
sourcepub fn new(config: FileSinkConfig, parquet_options: TableParquetOptions) -> Self
pub fn new(config: FileSinkConfig, parquet_options: TableParquetOptions) -> Self
Create from config.
sourcepub fn config(&self) -> &FileSinkConfig
pub fn config(&self) -> &FileSinkConfig
Retrieve the inner FileSinkConfig
.
sourcepub fn written(&self) -> HashMap<Path, FileMetaData>
pub fn written(&self) -> HashMap<Path, FileMetaData>
Retrieve the file metadata for the written files, keyed to the path which may be partitioned (in the case of hive style partitioning).
sourcepub fn parquet_options(&self) -> &TableParquetOptions
pub fn parquet_options(&self) -> &TableParquetOptions
Parquet options
Trait Implementations§
source§impl DataSink for ParquetSink
impl DataSink for ParquetSink
source§fn as_any(&self) -> &dyn Any
fn as_any(&self) -> &dyn Any
Returns the data sink as
Any
so that it can be
downcast to a specific implementation.source§fn metrics(&self) -> Option<MetricsSet>
fn metrics(&self) -> Option<MetricsSet>
source§fn write_all<'life0, 'life1, 'async_trait>(
&'life0 self,
data: SendableRecordBatchStream,
context: &'life1 Arc<TaskContext>,
) -> Pin<Box<dyn Future<Output = Result<u64>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
fn write_all<'life0, 'life1, 'async_trait>(
&'life0 self,
data: SendableRecordBatchStream,
context: &'life1 Arc<TaskContext>,
) -> Pin<Box<dyn Future<Output = Result<u64>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
Writes the data to the sink, returns the number of values written Read more
source§impl Debug for ParquetSink
impl Debug for ParquetSink
Auto Trait Implementations§
impl Freeze for ParquetSink
impl !RefUnwindSafe for ParquetSink
impl Send for ParquetSink
impl Sync for ParquetSink
impl Unpin for ParquetSink
impl !UnwindSafe for ParquetSink
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
source§impl<T> IntoEither for T
impl<T> IntoEither for T
source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left
is true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moresource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left(&self)
returns true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read more