Module manifest_list

Module manifest_list 

Source
Expand description

Manifest list handling and management for Iceberg tables.

This module provides the core types and implementations for working with manifest lists, which track all manifest files in a table snapshot. Key components include:

  • ManifestListEntry - Entries describing manifest files and their contents
  • Content - Types of content tracked by manifests (data vs deletes)
  • FieldSummary - Statistics and metadata about partition fields

Manifest lists are a critical part of Iceberg’s metadata hierarchy, providing an index of all manifest files and enabling efficient manifest pruning during scans. They include summary statistics that can be used to skip reading manifests that don’t contain relevant data for a query.

Structs§

FieldSummary
DataFile found in Manifest.
ManifestListEntry
A manifest list includes summary metadata that can be used to avoid scanning all of the manifests in a snapshot when planning a table scan. This includes the number of added, existing, and deleted files, and a summary of values for each field of the partition spec used to write the manifest.

Enums§

Content
Type of content stored by the data file.
ManifestListEntryEnum
Entry in manifest file.

Functions§

avro_value_to_manifest_list_entry
Convert an avro value result to a manifest list version according to the provided format version
manifest_list_schema_v1
manifest_list_schema_v2