Skip to main content

Module normalize

Module normalize 

Source
Expand description

Content normalization for deterministic hashing.

Normalization ensures that semantically equivalent content produces identical hashes, regardless of superficial differences like whitespace or Unicode representation.

Structs§

NormalizationConfig
Normalization configuration

Enums§

LineEndingNorm
Line ending normalization
UnicodeForm
Unicode normalization form (per TR15)
WhitespaceNorm
Whitespace normalization strategy

Functions§

canonical_json
Canonical JSON serialization (RFC 8785).
is_cjk_character
Check if a character is CJK (Chinese, Japanese, Korean)
normalize_content
Normalize content for hashing.
normalize_text
Normalize a text string according to configuration.