Struct RecordSink 

pub struct RecordSink { /* private fields */ }

Adapts any DatasetWriter into an ItemSink that streams records to one dataset file.

Records are forwarded over a bounded channel to a background writer task started in prepare, preserving backpressure; finish closes the channel and awaits the writer.

Implementations

impl RecordSink

pub fn new(writer: Arc<dyn DatasetWriter>, path: impl Into<PathBuf>) -> Self

Create a sink that writes records to path using writer.

impl RecordSink

pub fn path(&self) -> &Path

Path this sink writes to.

Trait Implementations

impl ItemSink<DatasetRecord> for RecordSink

fn name(&self) -> &str

Stable sink name.

fn prepare<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = AppResult<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Prepare the destination before any item is written (create directories, seed counters).

fn write<'life0, 'async_trait>( &'life0 self, item: DatasetRecord, ) -> Pin<Box<dyn Future<Output = AppResult<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Materialize a single collected item.

fn finish<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = AppResult<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Flush and finalize the destination after the last item is written.