Struct TextVector 

pub struct TextVector { /* private fields */ }

Simple TF-IDF vector for text similarity.

Tokenizes text into terms, computes normalized term frequency, and supports cosine similarity comparison. No external embedding model needed — language-agnostic.

Implementations

impl TextVector

pub fn from_text(text: &str) -> TextVector

Create a text vector from input text.

pub fn tokenize(text: &str) -> Vec<String>

Tokenize text into terms (language-agnostic). Splits on whitespace and punctuation, lowercases. Preserves non-ASCII alphanumeric runs (CJK, Hangul, etc.) within tokens.

pub fn tf_map(&self) -> &HashMap<String, f64>

Returns a reference to the term-frequency map.

pub fn cosine_similarity(&self, other: &TextVector) -> f64

Compute cosine similarity between two vectors.

Trait Implementations

impl Clone for TextVector

fn clone(&self) -> TextVector

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TextVector

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for TextVector

fn deserialize<__D>( __deserializer: __D, ) -> Result<TextVector, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for TextVector

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.