Expand description
Core data structures for the Hugging Face Xet storage system.
Provides merklehash::MerkleHash (256-bit content-addressed hashes),
metadata_shard (compact shard format mapping file ranges to Xorb
chunks), and xorb_object (content-addressed storage objects with
byte-grouping compression).
Re-exports§
pub use error::CoreError;pub use data_structures::MerkleHashMap;pub use data_structures::PassThroughHashMap;pub use data_structures::TruncatedMerkleHashMap;pub use data_structures::U64HashExtractable;pub use utils::ExpWeightedMovingAvg;pub use utils::serialization_utils;
Modules§
- data_
structures - error
- merklehash
- The merklehash module provides common and convenient operations around the DataHash (aliased to MerkleHash).
- metadata_
shard - utils
- xorb_
object