Struct BinaryHeader 

pub struct BinaryHeader {
    pub version: u32,
    pub tokenizer_type: String,
    pub compression_level: u8,
    pub uncompressed_size: u64,
    pub compressed_size: u64,
    pub checksum: u32,
    pub metadata: HashMap<String, String>,
    pub created_at: u64,
}

Header information for the binary format

Fields

version: u32

Format version for backward compatibility

tokenizer_type: String

Tokenizer type identifier

compression_level: u8

Compression level used (0 = none, 1-9 = zlib levels)

uncompressed_size: u64

Total size of the uncompressed data

compressed_size: u64

Total size of the compressed data

checksum: u32

Checksum of the uncompressed data

metadata: HashMap<String, String>

Metadata about the tokenizer

created_at: u64

Timestamp when this was created

Trait Implementations

impl Clone for BinaryHeader

fn clone(&self) -> BinaryHeader

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BinaryHeader

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for BinaryHeader

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for BinaryHeader

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.