Struct icu::normalizer::DecomposingNormalizer
source · pub struct DecomposingNormalizer { /* private fields */ }Expand description
A normalizer for performing decomposing normalization.
Implementations§
source§impl DecomposingNormalizer
impl DecomposingNormalizer
sourcepub const fn new_nfd() -> DecomposingNormalizer
pub const fn new_nfd() -> DecomposingNormalizer
NFD constructor using compiled data.
✨ Enabled with the compiled_data Cargo feature.
sourcepub fn try_new_nfd_with_any_provider(
provider: &(impl AnyProvider + ?Sized)
) -> Result<DecomposingNormalizer, NormalizerError>
pub fn try_new_nfd_with_any_provider( provider: &(impl AnyProvider + ?Sized) ) -> Result<DecomposingNormalizer, NormalizerError>
A version of Self::new_nfd that uses custom data provided by an AnyProvider.
sourcepub fn try_new_nfd_with_buffer_provider(
provider: &(impl BufferProvider + ?Sized)
) -> Result<DecomposingNormalizer, NormalizerError>
pub fn try_new_nfd_with_buffer_provider( provider: &(impl BufferProvider + ?Sized) ) -> Result<DecomposingNormalizer, NormalizerError>
A version of Self::new_nfd that uses custom data provided by a BufferProvider.
✨ Enabled with the serde feature.
sourcepub fn try_new_nfd_unstable<D>(
provider: &D
) -> Result<DecomposingNormalizer, NormalizerError>where
D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + ?Sized,
pub fn try_new_nfd_unstable<D>( provider: &D ) -> Result<DecomposingNormalizer, NormalizerError>where D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + ?Sized,
A version of Self::new_nfd that uses custom data provided by a DataProvider.
sourcepub const fn new_nfkd() -> DecomposingNormalizer
pub const fn new_nfkd() -> DecomposingNormalizer
NFKD constructor using compiled data.
✨ Enabled with the compiled_data Cargo feature.
sourcepub fn try_new_nfkd_with_any_provider(
provider: &(impl AnyProvider + ?Sized)
) -> Result<DecomposingNormalizer, NormalizerError>
pub fn try_new_nfkd_with_any_provider( provider: &(impl AnyProvider + ?Sized) ) -> Result<DecomposingNormalizer, NormalizerError>
A version of Self::new_nfkd that uses custom data provided by an AnyProvider.
sourcepub fn try_new_nfkd_with_buffer_provider(
provider: &(impl BufferProvider + ?Sized)
) -> Result<DecomposingNormalizer, NormalizerError>
pub fn try_new_nfkd_with_buffer_provider( provider: &(impl BufferProvider + ?Sized) ) -> Result<DecomposingNormalizer, NormalizerError>
A version of Self::new_nfkd that uses custom data provided by a BufferProvider.
✨ Enabled with the serde feature.
sourcepub fn try_new_nfkd_unstable<D>(
provider: &D
) -> Result<DecomposingNormalizer, NormalizerError>where
D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CompatibilityDecompositionSupplementV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + DataProvider<CompatibilityDecompositionTablesV1Marker> + ?Sized,
pub fn try_new_nfkd_unstable<D>( provider: &D ) -> Result<DecomposingNormalizer, NormalizerError>where D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CompatibilityDecompositionSupplementV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + DataProvider<CompatibilityDecompositionTablesV1Marker> + ?Sized,
A version of Self::new_nfkd that uses custom data provided by a DataProvider.
sourcepub fn normalize_iter<I>(&self, iter: I) -> Decomposition<'_, I> ⓘwhere
I: Iterator<Item = char>,
pub fn normalize_iter<I>(&self, iter: I) -> Decomposition<'_, I> ⓘwhere I: Iterator<Item = char>,
Wraps a delegate iterator into a decomposing iterator adapter by using the data already held by this normalizer.
sourcepub fn is_normalized(&self, text: &str) -> bool
pub fn is_normalized(&self, text: &str) -> bool
Check whether a string slice is normalized.
sourcepub fn normalize_utf16(&self, text: &[u16]) -> Vec<u16>
pub fn normalize_utf16(&self, text: &[u16]) -> Vec<u16>
Normalize a slice of potentially-invalid UTF-16 into a Vec.
Unpaired surrogates are mapped to the REPLACEMENT CHARACTER before normalizing.
sourcepub fn is_normalized_utf16(&self, text: &[u16]) -> bool
pub fn is_normalized_utf16(&self, text: &[u16]) -> bool
Checks whether a slice of potentially-invalid UTF-16 is normalized.
Unpaired surrogates are treated as the REPLACEMENT CHARACTER.
sourcepub fn normalize_utf8(&self, text: &[u8]) -> String
pub fn normalize_utf8(&self, text: &[u8]) -> String
Normalize a slice of potentially-invalid UTF-8 into a String.
Ill-formed byte sequences are mapped to the REPLACEMENT CHARACTER according to the WHATWG Encoding Standard.
sourcepub fn is_normalized_utf8(&self, text: &[u8]) -> bool
pub fn is_normalized_utf8(&self, text: &[u8]) -> bool
Check if a slice of potentially-invalid UTF-8 is normalized.
Ill-formed byte sequences are mapped to the REPLACEMENT CHARACTER according to the WHATWG Encoding Standard before checking.
sourcepub fn normalize_to<W>(&self, text: &str, sink: &mut W) -> Result<(), Error>where
W: Write + ?Sized,
pub fn normalize_to<W>(&self, text: &str, sink: &mut W) -> Result<(), Error>where W: Write + ?Sized,
Normalize a string slice into a Write sink.