Struct LocalBlobSink 

pub struct LocalBlobSink { /* private fields */ }

Local filesystem sink for DataItem samples.

Writes real samples to <output>/real and AI-generated samples to <output>/ai, naming files by a shared, monotonically increasing counter that resumes past any files already on disk.

Implementations

impl LocalBlobSink

pub fn new(output_dir: &Path, limits: DatasetLimits) -> Self

Create a sink rooted at output_dir, writing into its real/ and ai/ subdirectories.

Trait Implementations

impl ItemSink<DataItem> for LocalBlobSink

fn name(&self) -> &str

Stable sink name.

fn prepare<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = AppResult<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Prepare the destination before any item is written (create directories, seed counters).

fn write<'life0, 'async_trait>( &'life0 self, item: DataItem, ) -> Pin<Box<dyn Future<Output = AppResult<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Materialize a single collected item.

fn finish<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = AppResult<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Flush and finalize the destination after the last item is written.