Struct BagOfWordsFeatureGroup

pub struct BagOfWordsFeatureGroup {
    pub source_column_name: String,
    pub strategy: BagOfWordsFeatureGroupStrategy,
    pub tokenizer: Tokenizer,
    pub ngram_types: FnvHashSet<NGramType>,
    pub ngrams: IndexMap<NGram, BagOfWordsFeatureGroupNGramEntry, FnvBuildHasher>,
}

A BagOfWordsFeatureGroup creates features for a text column using the Bag of Words method.

Fields

source_column_name: String

This is the name of the text column used to compute features with this feature group.

strategy: BagOfWordsFeatureGroupStrategy

The strategy specifies how to compute feature values given the tokens in the source column.

tokenizer: Tokenizer

This is the tokenizer used to split the text into tokens.

ngram_types: FnvHashSet<NGramType>

These are the ngram types used to create features.

ngrams: IndexMap<NGram, BagOfWordsFeatureGroupNGramEntry, FnvBuildHasher>

These are the ngrams, one for each feature in this feature group.

Implementations

impl BagOfWordsFeatureGroup

pub fn compute_table( &self, column: TableColumnView<'_>, progress: &impl Fn(u64), ) -> Vec<TableColumn>

pub fn compute_array_f32( &self, features: ArrayViewMut2<'_, f32>, column: TableColumnView<'_>, progress: &impl Fn(), )

pub fn compute_array_value( &self, features: ArrayViewMut2<'_, TableValue<'_>>, column: TableColumnView<'_>, progress: &impl Fn(), )

Trait Implementations

impl Clone for BagOfWordsFeatureGroup

fn clone(&self) -> BagOfWordsFeatureGroup

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BagOfWordsFeatureGroup

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.