Struct TFIDFData 

pub struct TFIDFData<N = f32, K = String, E = DefaultTFIDFEngine>
where
    N: Num + Copy,
    E: TFIDFEngine<N>,
    K: Clone + Eq + Hash,
{
    pub documents: IndexMap<KeyRc<K>, TFVector<N>>,
    pub term_dim_sample: Vec<Box<str>>,
    pub idf: Option<IDFVector>,
    /* private fields */
}

TF-IDF Vectorizer Data Structure (Corpus-free)

A compact, serializable representation of a TF-IDF vectorizer.

Unlike TFIDFVectorizer, this struct does not hold a Corpus reference. It can be converted back into a TFIDFVectorizer by providing an Arc<Corpus>.

Use Cases

• Persistent storage
• Network transfer
• Memory-efficient snapshots

Serialization

Supported.

Deserialization

Supported, including internal data expansion.

Fields

documents: IndexMap<KeyRc<K>, TFVector<N>>

TF vectors for documents

term_dim_sample: Vec<Box<str>>

term dimension sample for TF vectors

idf: Option<IDFVector>

IDF vector

Implementations

impl<N, K, E> TFIDFData<N, K, E>

where N: Num + Copy + Into<f64> + Send + Sync, E: TFIDFEngine<N>, K: Clone + Send + Sync + Eq + Hash,

pub fn into_tf_idf_vectorizer( self, corpus_ref: Arc<Corpus>, ) -> TFIDFVectorizer<N, K, E>

Convert TFIDFData into TFIDFVectorizer. corpus_ref is a reference to the corpus.

Trait Implementations

impl<N, K, E> Debug for TFIDFData<N, K, E>

where N: Num + Copy + Debug, E: TFIDFEngine<N> + Debug, K: Clone + Eq + Hash + Debug,

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de, N, K, E> Deserialize<'de> for TFIDFData<N, K, E>

where N: Num + Copy + Deserialize<'de>, E: TFIDFEngine<N>, K: Clone + Eq + Hash + Deserialize<'de>,

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl<N, K, E> Serialize for TFIDFData<N, K, E>

where N: Num + Copy + Serialize, E: TFIDFEngine<N>, K: Clone + Eq + Hash + Serialize,

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.