Struct WriteBackProcessor 

pub struct WriteBackProcessor { /* private fields */ }

Available on crate feature pipeline only.

Writes the current payload bytes back to disk. If a write_back_extension metadata key is present, the bytes are written to {original}{extension} and the original segment file is removed. When dir is set, the file is written to that directory instead of alongside the original.

Implementations

impl WriteBackProcessor

pub fn to_dir(dir: PathBuf) -> Self

Write to dir instead of alongside the original segment.

Trait Implementations

impl Debug for WriteBackProcessor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for WriteBackProcessor

fn default() -> WriteBackProcessor

Returns the “default value” for a type.

impl SegmentProcessor for WriteBackProcessor

fn name(&self) -> &'static str

Human-readable name for this processor (used in metrics).

fn process( &mut self, data: SegmentData, ) -> Pin<Box<dyn Future<Output = Result<SegmentData, ProcessError>> + Send + '_>>

Process a segment, transforming or consuming its data. Returns the (possibly modified) data for the next processor, or an error to skip this segment.

fn initialize( &mut self, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + '_>>

Initialize this processor on the worker’s Tokio runtime before the pipeline begins processing segments.

fn finalize_dump( &mut self, completion: &DumpCompletion, ) -> Pin<Box<dyn Future<Output = Option<String>> + Send + '_>>

Called once per finished dump in triggered mode (see crate::dump), in pipeline order, so stages can flush any per-dump state they accumulated. Return the S3 key of a manifest written for this dump, or None; the last Some across the pipeline lands on DumpReceipt::manifest_key.