[−][src]Struct punkt::Trainer

pub struct Trainer<P> { /* fields omitted */ }

A trainer will build data about abbreviations, sentence starters, collocations, and context that tokens appear in. The data is used by the sentence tokenizer to determine if a period is likely part of an abbreviation, or actually marks the termination of a sentence.

Methods

impl<P> Trainer<P> where
    P: TrainerParameters + DefinesNonPrefixCharacters + DefinesNonWordCharacters, [src]

pub fn new() -> Trainer<P>[src]

Creates a new Trainer.

pub fn train(&self, doc: &str, data: &mut TrainingData)[src]

Train on a document. Does tokenization using a WordTokenizer.

Auto Trait Implementations

impl<P> Send for Trainer<P> where
    P: Send, 

impl<P> Sync for Trainer<P> where
    P: Sync, 

Blanket Implementations

impl<T> From for T[src]

impl<T, U> Into for T where
    U: From<T>, [src]

impl<T, U> TryFrom for T where
    U: Into<T>, [src]

type Error = !

🔬 This is a nightly-only experimental API. (try_from)

The type returned in the event of a conversion error.

impl<T> Borrow for T where
    T: ?Sized, [src]

impl<T> Any for T where
    T: 'static + ?Sized, [src]

impl<T> BorrowMut for T where
    T: ?Sized, [src]

impl<T, U> TryInto for T where
    U: TryFrom<T>, [src]

type Error = <U as TryFrom<T>>::Error

🔬 This is a nightly-only experimental API. (try_from)

The type returned in the event of a conversion error.