xet-data 1.6.0

Data processing pipeline for chunking, deduplication, and file reconstruction; used in the Hugging Face Xet client tools. Intended to be used through the API in the hf-xet package.
Documentation
1
2
3
4
5
6
7
8
mod progress_types;
mod speed_tracker;
pub mod upload_tracking;

pub use progress_types::{
    GroupProgress, GroupProgressReport, ItemProgress, ItemProgressReport, ItemProgressUpdater,
    ShardUploadProgressReport, UploadGroupProgress,
};