pub struct TfIdfEmbeddingGenerator { /* private fields */ }Expand description
Simple TF-IDF based embedding generator
Implementations§
Source§impl TfIdfEmbeddingGenerator
impl TfIdfEmbeddingGenerator
pub fn new(config: EmbeddingConfig) -> Self
Sourcepub fn build_vocabulary(&mut self, documents: &[String]) -> Result<()>
pub fn build_vocabulary(&mut self, documents: &[String]) -> Result<()>
Build vocabulary from a corpus of documents
Trait Implementations§
Source§impl AsAny for TfIdfEmbeddingGenerator
impl AsAny for TfIdfEmbeddingGenerator
Source§impl EmbeddingGenerator for TfIdfEmbeddingGenerator
impl EmbeddingGenerator for TfIdfEmbeddingGenerator
Source§fn generate(&self, content: &EmbeddableContent) -> Result<Vector>
fn generate(&self, content: &EmbeddableContent) -> Result<Vector>
Generate embedding for content
Source§fn dimensions(&self) -> usize
fn dimensions(&self) -> usize
Get the embedding dimensions
Source§fn config(&self) -> &EmbeddingConfig
fn config(&self) -> &EmbeddingConfig
Get the model configuration
Source§fn generate_batch(&self, contents: &[EmbeddableContent]) -> Result<Vec<Vector>>
fn generate_batch(&self, contents: &[EmbeddableContent]) -> Result<Vec<Vector>>
Generate embeddings for multiple contents in batch
Auto Trait Implementations§
impl Freeze for TfIdfEmbeddingGenerator
impl RefUnwindSafe for TfIdfEmbeddingGenerator
impl Send for TfIdfEmbeddingGenerator
impl Sync for TfIdfEmbeddingGenerator
impl Unpin for TfIdfEmbeddingGenerator
impl UnwindSafe for TfIdfEmbeddingGenerator
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.