Module manifest

Module manifest 

Source
Expand description

Manifest file handling and data file tracking for Iceberg tables.

This module provides the core types and implementations for working with manifest files, which track the data files that comprise an Iceberg table. Key components include:

  • ManifestEntry - Entries tracking data file additions and deletions
  • DataFile - Metadata about data files including statistics and metrics
  • Content - Types of content stored in data files (data vs deletes)
  • Status - Tracking additions and deletions of files
  • FileFormat - Supported file formats (Avro, ORC, Parquet)

Manifest files are a key part of Iceberg’s architecture, providing metadata about data files and enabling efficient file pruning during queries.

Structs§

AvroMap
Utility struct to convert avro maps to rust hashmaps. Derefences to a Hashmap.
DataFile
DataFile found in Manifest.
DataFileBuilder
Builder for DataFile.
DataFileV1
DataFile found in Manifest.
DataFileV2
DataFile found in Manifest.
ManifestEntry
Entry in manifest with the iceberg spec version 2.
ManifestEntryBuilder
Builder for ManifestEntry.
ManifestEntryV1
Entry in manifest with the iceberg spec version 1.
ManifestEntryV2
Entry in manifest with the iceberg spec version 2.

Enums§

Content
Type of content stored by the data file.
FileFormat
Name of file format
ManifestEntryEnum
Entry in manifest
Status
Used to track additions and deletions

Functions§

partition_value_schema
Get schema for partition values depending on partition spec and table schema