Skip to main content

unicode_normalize_variants

redstr

Function unicode_normalize_variants 

Source 
pub fn unicode_normalize_variants(input: &str) -> String
Expand description

Generates unicode normalization variations (NFD, NFC, NFKC, NFKD concepts).

Creates variations that represent similar Unicode normalization concepts by randomly replacing characters with composed or decomposed forms, or adding combining characters. Tests how systems handle different Unicode normalization forms (NFC, NFD, NFKC, NFKD).

§Use Cases

  • Security Testing: Test if systems normalize Unicode properly
  • Bypass Filters: Exploit inconsistent Unicode handling
  • Blue Team: Validate Unicode normalization in security controls
  • Data Quality: Test string comparison and matching

§Examples

use redstr::unicode_normalize_variants;

let result = unicode_normalize_variants("café");
// May produce composed (café) or decomposed (cafe\u{0301}) forms
assert!(result.len() >= 4);