Skip to main content

Module schema_filler

Module schema_filler 

Source
Expand description

Schema filler — inject missing columns at read time (Phase G).

When the table schema has been evolved by adding new columns, old data files do not contain those columns. SchemaFiller::fill detects absent columns and appends them to the RecordBatch, filled with the field’s initial_default (or null when no default is set). This implements schema evolution without rewriting data files, equivalent to Iceberg V2/V3 §4.1.1.

Structs§

SchemaFiller

Functions§

iceberg_type_to_arrow
Map an Iceberg type string to an Arrow DataType.