Expand description
Manifest list handling and management for Iceberg tables.
This module provides the core types and implementations for working with manifest lists, which track all manifest files in a table snapshot. Key components include:
ManifestListEntry- Entries describing manifest files and their contentsContent- Types of content tracked by manifests (data vs deletes)FieldSummary- Statistics and metadata about partition fields
Manifest lists are a critical part of Iceberg’s metadata hierarchy, providing an index of all manifest files and enabling efficient manifest pruning during scans. They include summary statistics that can be used to skip reading manifests that don’t contain relevant data for a query.
Structs§
- Field
Summary - DataFile found in Manifest.
- Manifest
List Entry - A manifest list includes summary metadata that can be used to avoid scanning all of the manifests in a snapshot when planning a table scan. This includes the number of added, existing, and deleted files, and a summary of values for each field of the partition spec used to write the manifest.
Enums§
- Content
- Type of content stored by the data file.
- Manifest
List Entry Enum - Entry in manifest file.
Functions§
- avro_
value_ to_ manifest_ list_ entry - Convert an avro value result to a manifest list version according to the provided format version
- manifest_
list_ schema_ v1 - manifest_
list_ schema_ v2