Struct icu_normalizer::DecomposingNormalizer
source · [−]pub struct DecomposingNormalizer { /* private fields */ }Expand description
A normalizer for performing decomposing normalization.
Implementations
sourceimpl DecomposingNormalizer
impl DecomposingNormalizer
sourcepub fn try_new_nfd_unstable<D>(
data_provider: &D
) -> Result<Self, NormalizerError>where
D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + ?Sized,
pub fn try_new_nfd_unstable<D>(
data_provider: &D
) -> Result<Self, NormalizerError>where
D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + ?Sized,
NFD constructor.
sourcepub fn try_new_nfd_with_any_provider(
provider: &impl AnyProvider + ?Sized
) -> Result<Self, NormalizerError>
pub fn try_new_nfd_with_any_provider(
provider: &impl AnyProvider + ?Sized
) -> Result<Self, NormalizerError>
Creates a new instance using an AnyProvider.
For details on the behavior of this function, see: Self::try_new_nfd_unstable
sourcepub fn try_new_nfd_with_buffer_provider(
provider: &impl BufferProvider + ?Sized
) -> Result<Self, NormalizerError>
pub fn try_new_nfd_with_buffer_provider(
provider: &impl BufferProvider + ?Sized
) -> Result<Self, NormalizerError>
✨ Enabled with the "serde" feature.
Creates a new instance using a BufferProvider.
For details on the behavior of this function, see: Self::try_new_nfd_unstable
sourcepub fn try_new_nfkd_unstable<D>(
data_provider: &D
) -> Result<Self, NormalizerError>where
D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CompatibilityDecompositionSupplementV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + DataProvider<CompatibilityDecompositionTablesV1Marker> + ?Sized,
pub fn try_new_nfkd_unstable<D>(
data_provider: &D
) -> Result<Self, NormalizerError>where
D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CompatibilityDecompositionSupplementV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + DataProvider<CompatibilityDecompositionTablesV1Marker> + ?Sized,
NFKD constructor.
sourcepub fn try_new_nfkd_with_any_provider(
provider: &impl AnyProvider + ?Sized
) -> Result<Self, NormalizerError>
pub fn try_new_nfkd_with_any_provider(
provider: &impl AnyProvider + ?Sized
) -> Result<Self, NormalizerError>
Creates a new instance using an AnyProvider.
For details on the behavior of this function, see: Self::try_new_nfkd_unstable
sourcepub fn try_new_nfkd_with_buffer_provider(
provider: &impl BufferProvider + ?Sized
) -> Result<Self, NormalizerError>
pub fn try_new_nfkd_with_buffer_provider(
provider: &impl BufferProvider + ?Sized
) -> Result<Self, NormalizerError>
✨ Enabled with the "serde" feature.
Creates a new instance using a BufferProvider.
For details on the behavior of this function, see: Self::try_new_nfkd_unstable
sourcepub fn normalize_iter<I: Iterator<Item = char>>(
&self,
iter: I
) -> Decomposition<'_, I>ⓘNotable traits for Decomposition<'data, I>impl<'data, I> Iterator for Decomposition<'data, I>where
I: Iterator<Item = char>, type Item = char;
pub fn normalize_iter<I: Iterator<Item = char>>(
&self,
iter: I
) -> Decomposition<'_, I>ⓘNotable traits for Decomposition<'data, I>impl<'data, I> Iterator for Decomposition<'data, I>where
I: Iterator<Item = char>, type Item = char;
I: Iterator<Item = char>, type Item = char;
Wraps a delegate iterator into a decomposing iterator adapter by using the data already held by this normalizer.
sourcepub fn is_normalized(&self, text: &str) -> bool
pub fn is_normalized(&self, text: &str) -> bool
Check whether a string slice is normalized.
sourcepub fn normalize_utf16(&self, text: &[u16]) -> Vec<u16>
pub fn normalize_utf16(&self, text: &[u16]) -> Vec<u16>
Normalize a slice of potentially-invalid UTF-16 into a Vec.
Unpaired surrogates are mapped to the REPLACEMENT CHARACTER before normalizing.
sourcepub fn is_normalized_utf16(&self, text: &[u16]) -> bool
pub fn is_normalized_utf16(&self, text: &[u16]) -> bool
Checks whether a slice of potentially-invalid UTF-16 is normalized.
Unpaired surrogates are treated as the REPLACEMENT CHARACTER.
sourcepub fn normalize_utf8(&self, text: &[u8]) -> String
pub fn normalize_utf8(&self, text: &[u8]) -> String
Normalize a slice of potentially-invalid UTF-8 into a String.
Errors are mapped to the REPLACEMENT CHARACTER according to the WHATWG Encoding Standard.
sourcepub fn is_normalized_utf8(&self, text: &[u8]) -> bool
pub fn is_normalized_utf8(&self, text: &[u8]) -> bool
Check if a slice of potentially-invalid UTF-8 is normalized.
Errors are mapped to the REPLACEMENT CHARACTER according to the WHATWG Encoding Standard before checking.
sourcepub fn normalize_to<W: Write + ?Sized>(&self, text: &str, sink: &mut W) -> Result
pub fn normalize_to<W: Write + ?Sized>(&self, text: &str, sink: &mut W) -> Result
Normalize a string slice into a Write sink.