emoji-sanitize 0.1.0

Normalize or strip emoji-related Unicode (presentation selectors, variation selectors, zero-width joiners) from text before LLM input. Zero deps.
Documentation
  • Coverage
  • 100%
    4 out of 4 items documented1 out of 4 items with examples
  • Size
  • Source code size: 18.18 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 253.17 kB This is the summed size of all files generated by rustdoc for all configured targets
  • Ø build duration
  • this release: 16s Average build duration of successful builds.
  • all releases: 16s Average build duration of successful builds in releases after 2024-10-23.
  • Links
  • Homepage
  • MukundaKatta/emoji-sanitize
    0 0 0
  • crates.io
  • Dependencies
    • —
  • Versions
  • Owners
  • MukundaKatta

emoji-sanitize

crates.io

Strip emoji-related Unicode (VS16, ZWJ, skin-tone modifiers) before LLM input, or drop emoji entirely.

use emoji_sanitize::{strip_modifiers, strip_all_emoji};
let s = "Hi \u{1F468}\u{200D}\u{1F469}\u{200D}\u{1F467}!";
assert_eq!(strip_modifiers(s), "Hi \u{1F468}\u{1F469}\u{1F467}!");

Zero deps. MIT or Apache-2.0.