Struct CheckpointSection 

#[non_exhaustive]
pub struct CheckpointSection {
    pub interval: Duration,
    pub max_pending_batches: usize,
    pub drain_timeout: Duration,
    pub stalled_fail_after: Duration,
}

Watermark commit policy (checkpoint:).

Construct with CheckpointSection::default and set the fields. The struct is #[non_exhaustive] so new knobs can be added without breaking callers.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

interval: Duration

How often committable watermarks are flushed to the source.

max_pending_batches: usize

Hard per-partition ceiling on unacknowledged batches. A partition at the ceiling has its lanes skipped at the poll boundary until acknowledgments retire batches. No pause is involved, and other partitions are unaffected. Bounds tracker memory and the replay a stalled partition can accumulate.

drain_timeout: Duration

Shutdown/rebalance drain budget. Must be comfortably below the pod’s terminationGracePeriodSeconds.

stalled_fail_after: Duration

A partition watermark stalled behind a failed batch for longer than this fails the pipeline. Failed batches only stall watermarks permanently (their data replays after restart), so this converts a permanent sink failure (a dropped table, revoked credentials) into a clean Failed exit and a restart instead of a process that runs on forever, consuming the source but committing nothing for that partition.

Trait Implementations

impl Debug for CheckpointSection

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CheckpointSection

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for CheckpointSection

where CheckpointSection: Default,

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for CheckpointSection

fn eq(&self, other: &CheckpointSection) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for CheckpointSection