Skip to main content

Module cdc

Module cdc 

Source
Expand description

Change Data Capture (CDC) reader for AI-Lake tables.

CDC is implemented as a read-only operation over the existing snapshot history. No table-level flag is required: any AI-Lake table with multiple snapshots can produce a change stream as long as the old snapshots and data files are still reachable.

The reader compares two snapshots and emits rows annotated with a change envelope (_change_type, _snapshot_id, _sequence_number, _commit_timestamp).

Structs§

ChangeReaderConfig
Configuration for read_changes.
ChangeRecord
One changed row, carrying the row data plus CDC metadata.

Enums§

ChangeType
Type of change for a single row.

Functions§

read_changes
Read the change stream between two snapshots of an AI-Lake table.