Struct UnicodeSentenceSplitter

pub struct UnicodeSentenceSplitter {}

Split Large chunks of text into sentances according to the Unicode definition of a Sentence.

Uses [UnicodeSegmentation::split_sentence_bounds] under the hood.

Implementations

impl UnicodeSentenceSplitter

pub fn new() -> Self

Create a new UnicodeSentenceSplitter instance

Trait Implementations

impl Clone for UnicodeSentenceSplitter

fn clone(&self) -> UnicodeSentenceSplitter

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for UnicodeSentenceSplitter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for UnicodeSentenceSplitter

fn default() -> UnicodeSentenceSplitter

Returns the “default value” for a type.

impl Segmenter for UnicodeSentenceSplitter

type SubdivisionIter<'a> = IntoIter<SegmentedToken<'a>>

The iterator type returned by the subdivide function if it has multiple results.

fn subdivide<'a>( &self, token: SegmentedToken<'a>, ) -> UseOrSubdivide<SegmentedToken<'a>, IntoIter<SegmentedToken<'a>>>

A method that should split the given token into zero, one or more subtokens.