Struct icu_normalizer::DecomposingNormalizer
source · pub struct DecomposingNormalizer { /* private fields */ }
Expand description
A normalizer for performing decomposing normalization.
Implementations§
source§impl DecomposingNormalizer
impl DecomposingNormalizer
sourcepub fn try_new_nfd_unstable<D>(
data_provider: &D
) -> Result<Self, NormalizerError>where
D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + ?Sized,
pub fn try_new_nfd_unstable<D>( data_provider: &D ) -> Result<Self, NormalizerError>where D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + ?Sized,
NFD constructor.
sourcepub fn try_new_nfd_with_any_provider(
provider: &impl AnyProvider + ?Sized
) -> Result<Self, NormalizerError>
pub fn try_new_nfd_with_any_provider( provider: &impl AnyProvider + ?Sized ) -> Result<Self, NormalizerError>
Creates a new instance using an AnyProvider
.
For details on the behavior of this function, see: Self::try_new_nfd_unstable
sourcepub fn try_new_nfd_with_buffer_provider(
provider: &impl BufferProvider + ?Sized
) -> Result<Self, NormalizerError>
pub fn try_new_nfd_with_buffer_provider( provider: &impl BufferProvider + ?Sized ) -> Result<Self, NormalizerError>
✨ Enabled with the "serde"
feature.
Creates a new instance using a BufferProvider
.
For details on the behavior of this function, see: Self::try_new_nfd_unstable
sourcepub fn try_new_nfkd_unstable<D>(
data_provider: &D
) -> Result<Self, NormalizerError>where
D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CompatibilityDecompositionSupplementV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + DataProvider<CompatibilityDecompositionTablesV1Marker> + ?Sized,
pub fn try_new_nfkd_unstable<D>( data_provider: &D ) -> Result<Self, NormalizerError>where D: DataProvider<CanonicalDecompositionDataV1Marker> + DataProvider<CompatibilityDecompositionSupplementV1Marker> + DataProvider<CanonicalDecompositionTablesV1Marker> + DataProvider<CompatibilityDecompositionTablesV1Marker> + ?Sized,
NFKD constructor.
sourcepub fn try_new_nfkd_with_any_provider(
provider: &impl AnyProvider + ?Sized
) -> Result<Self, NormalizerError>
pub fn try_new_nfkd_with_any_provider( provider: &impl AnyProvider + ?Sized ) -> Result<Self, NormalizerError>
Creates a new instance using an AnyProvider
.
For details on the behavior of this function, see: Self::try_new_nfkd_unstable
sourcepub fn try_new_nfkd_with_buffer_provider(
provider: &impl BufferProvider + ?Sized
) -> Result<Self, NormalizerError>
pub fn try_new_nfkd_with_buffer_provider( provider: &impl BufferProvider + ?Sized ) -> Result<Self, NormalizerError>
✨ Enabled with the "serde"
feature.
Creates a new instance using a BufferProvider
.
For details on the behavior of this function, see: Self::try_new_nfkd_unstable
sourcepub fn normalize_iter<I: Iterator<Item = char>>(
&self,
iter: I
) -> Decomposition<'_, I> ⓘ
pub fn normalize_iter<I: Iterator<Item = char>>( &self, iter: I ) -> Decomposition<'_, I> ⓘ
Wraps a delegate iterator into a decomposing iterator adapter by using the data already held by this normalizer.
sourcepub fn is_normalized(&self, text: &str) -> bool
pub fn is_normalized(&self, text: &str) -> bool
Check whether a string slice is normalized.
sourcepub fn normalize_utf16(&self, text: &[u16]) -> Vec<u16>
pub fn normalize_utf16(&self, text: &[u16]) -> Vec<u16>
Normalize a slice of potentially-invalid UTF-16 into a Vec
.
Unpaired surrogates are mapped to the REPLACEMENT CHARACTER before normalizing.
sourcepub fn is_normalized_utf16(&self, text: &[u16]) -> bool
pub fn is_normalized_utf16(&self, text: &[u16]) -> bool
Checks whether a slice of potentially-invalid UTF-16 is normalized.
Unpaired surrogates are treated as the REPLACEMENT CHARACTER.
sourcepub fn normalize_utf8(&self, text: &[u8]) -> String
pub fn normalize_utf8(&self, text: &[u8]) -> String
Normalize a slice of potentially-invalid UTF-8 into a String
.
Ill-formed byte sequences are mapped to the REPLACEMENT CHARACTER according to the WHATWG Encoding Standard.
sourcepub fn is_normalized_utf8(&self, text: &[u8]) -> bool
pub fn is_normalized_utf8(&self, text: &[u8]) -> bool
Check if a slice of potentially-invalid UTF-8 is normalized.
Ill-formed byte sequences are mapped to the REPLACEMENT CHARACTER according to the WHATWG Encoding Standard before checking.
sourcepub fn normalize_to<W: Write + ?Sized>(
&self,
text: &str,
sink: &mut W
) -> Result
pub fn normalize_to<W: Write + ?Sized>( &self, text: &str, sink: &mut W ) -> Result
Normalize a string slice into a Write
sink.