Skip to main content

MAX_PICKLE_SIZE

Constant MAX_PICKLE_SIZE 

Source
pub const MAX_PICKLE_SIZE: u64 = _; // 104_857_600u64
Expand description

Largest data.pkl accepted from a ZIP checkpoint (100 MiB).

Only that container needs a ceiling: a deflated entry can claim any decompressed size, while the other containers’ pickles are parsed straight off the file. The pickle holds tensor metadata and whatever non-tensor values were saved alongside; the tensor bytes live in separate entries and are never subject to this limit.