Enum IcebergTransactionMode 

pub enum IcebergTransactionMode {
    None,
    Snapshot,
    Catchup,
    Always,
}

Iceberg table transaction mode.

Determines how the connector breaks up its input into Feldera transactions.

• none - the connector does not group its input into transactions.
• snapshot - ingest the initial snapshot in one or more transactions (see below). Changes ingested afterward, in the follow phase, are not grouped into transactions.
• catchup - ingest the initial snapshot like snapshot. In the follow phase, the connector batches all currently available table commits into a single transaction. Once that transaction completes, it checks for commits added since the transaction began, ingests them in the next transaction, and repeats continuously. Most efficient for backfill and steady-state following.
• always - ingest the initial snapshot like snapshot. In the follow phase, each table commit is ingested in its own transaction.

How the table snapshot is ingested using transactions

For the initial snapshot (snapshot, catchup, and always all behave the same), the connector ingests the snapshot in one or several transactions, depending on timestamp_column. If timestamp_column is not set, the whole snapshot is ingested in a single Feldera transaction. If timestamp_column is set, the connector ingests the snapshot in a series of timestamp ranges of width equal to the LATENESS attribute of the column, each range in a separate transaction.

JSON schema

{
 "description": "Iceberg table transaction mode.\n\nDetermines how the connector breaks up its input into Feldera transactions.\n\n* `none` - the connector does not group its input into transactions.\n* `snapshot` - ingest the initial snapshot in one or more transactions (see below). Changes\ningested afterward, in the follow phase, are not grouped into transactions.\n* `catchup` - ingest the initial snapshot like `snapshot`. In the follow phase, the connector\nbatches all currently available table commits into a single transaction. Once that transaction\ncompletes, it checks for commits added since the transaction began, ingests them in the next\ntransaction, and repeats continuously. Most efficient for backfill and steady-state following.\n* `always` - ingest the initial snapshot like `snapshot`. In the follow phase, each table commit\nis ingested in its own transaction.\n\n# How the table snapshot is ingested using transactions\n\nFor the initial snapshot (`snapshot`, `catchup`, and `always` all behave the same), the\nconnector ingests the snapshot in one or several transactions, depending on `timestamp_column`.\nIf `timestamp_column` is not set, the whole snapshot is ingested in a single Feldera\ntransaction. If `timestamp_column` is set, the connector ingests the snapshot in a series of\ntimestamp ranges of width equal to the `LATENESS` attribute of the column, each range in a\nseparate transaction.",
 "type": "string",
 "enum": [
   "none",
   "snapshot",
   "catchup",
   "always"
 ]
}

Variants

None

Snapshot

Catchup

Always

Trait Implementations

impl Clone for IcebergTransactionMode

fn clone(&self) -> IcebergTransactionMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for IcebergTransactionMode

impl Debug for IcebergTransactionMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for IcebergTransactionMode

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for IcebergTransactionMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for IcebergTransactionMode

impl From<&IcebergTransactionMode> for IcebergTransactionMode

fn from(value: &IcebergTransactionMode) -> Self

Converts to this type from the input type.

impl FromStr for IcebergTransactionMode

type Err = ConversionError

The associated error which can be returned from parsing.

fn from_str(value: &str) -> Result<Self, ConversionError>

Parses a string s to return a value of this type.

impl Hash for IcebergTransactionMode

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Ord for IcebergTransactionMode

fn cmp(&self, other: &IcebergTransactionMode) -> Ordering

This method returns an Ordering between self and other.

fn max(self, other: Self) -> Self

where Self: Sized,

Compares and returns the maximum of two values.

fn min(self, other: Self) -> Self

where Self: Sized,

Compares and returns the minimum of two values.

fn clamp(self, min: Self, max: Self) -> Self

where Self: Sized,

Restrict a value to a certain interval.

fn clamp_to<R>(self, range: R) -> Self

where Self: Sized, R: ClampBounds<Self>,

🔬This is a nightly-only experimental API. (clamp_to)

Restrict a value to a certain range.

impl PartialEq for IcebergTransactionMode

fn eq(&self, other: &IcebergTransactionMode) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl PartialOrd for IcebergTransactionMode

fn partial_cmp(&self, other: &IcebergTransactionMode) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl Serialize for IcebergTransactionMode

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for IcebergTransactionMode

impl TryFrom<&String> for IcebergTransactionMode

type Error = ConversionError

The type returned in the event of a conversion error.

fn try_from(value: &String) -> Result<Self, ConversionError>

Performs the conversion.

impl TryFrom<&str> for IcebergTransactionMode

type Error = ConversionError

The type returned in the event of a conversion error.

fn try_from(value: &str) -> Result<Self, ConversionError>

Performs the conversion.

impl TryFrom<String> for IcebergTransactionMode

type Error = ConversionError

The type returned in the event of a conversion error.

fn try_from(value: String) -> Result<Self, ConversionError>

Performs the conversion.