Struct SourceCtx 

#[non_exhaustive]
pub struct SourceCtx {
    pub task: usize,
    pub tasks: usize,
    pub start: Option<BTreeMap<i32, i64>>,
    pub restoring: bool,
    pub watermark_column: Option<String>,
    pub pipeline: String,
    pub stage: String,
    pub build_id: String,
    pub dropped: Arc<Atomic<u64>>,
}

What a source task is built with: its index task of tasks; the positions the checkpoint recorded for it under the source’s name (start: partition → next position, None when the run is fresh or the checkpoint has none for this task — restoring tells the two apart); the event-time column it stamps watermarks from; the run’s identity for a source that names itself to a broker (a consumer group is pipeline + stage); and the counter of rows it drops as bad data. Built by the engine only (#[non_exhaustive]: new fields arrive as new setters, never as a break).

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

task: usize

tasks: usize

start: Option<BTreeMap<i32, i64>>

restoring: bool

watermark_column: Option<String>

pipeline: String

stage: String

build_id: String

dropped: Arc<Atomic<u64>>

Implementations

impl SourceCtx

pub fn new(task: usize, tasks: usize) -> SourceCtx

pub fn start(self, start: Option<BTreeMap<i32, i64>>) -> SourceCtx

pub fn restoring(self, restoring: bool) -> SourceCtx

pub fn watermark_column(self, column: Option<String>) -> SourceCtx

pub fn run(self, pipeline: &str, stage: &str, build_id: &str) -> SourceCtx

pub fn dropped(self, dropped: Arc<Atomic<u64>>) -> SourceCtx

pub fn start_of_task(&self) -> Option<i64>

This task’s own recorded position, for a source whose partition is its task index (every in-process source; a broker source reads the whole map).

Trait Implementations

impl Clone for SourceCtx

fn clone(&self) -> SourceCtx

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SourceCtx

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.