pub struct HuggingFaceEmbedder { /* private fields */ }Expand description
HuggingFace transformer model for embedding generation
Implementations§
Source§impl HuggingFaceEmbedder
impl HuggingFaceEmbedder
Sourcepub fn new(config: HuggingFaceConfig) -> Result<Self>
pub fn new(config: HuggingFaceConfig) -> Result<Self>
Create a new HuggingFace embedder
Sourcepub fn with_default_config() -> Result<Self>
pub fn with_default_config() -> Result<Self>
Create embedder with default configuration
Sourcepub async fn load_model(&mut self, model_name: &str) -> Result<()>
pub async fn load_model(&mut self, model_name: &str) -> Result<()>
Load a model and prepare it for inference
Sourcepub async fn embed_batch(
&mut self,
contents: &[EmbeddableContent],
) -> Result<Vec<Vector>>
pub async fn embed_batch( &mut self, contents: &[EmbeddableContent], ) -> Result<Vec<Vector>>
Generate embeddings for a batch of content
Sourcepub async fn embed(&mut self, content: &EmbeddableContent) -> Result<Vector>
pub async fn embed(&mut self, content: &EmbeddableContent) -> Result<Vector>
Generate a single embedding
Sourcepub fn get_cached_models(&self) -> Vec<String>
pub fn get_cached_models(&self) -> Vec<String>
Get available models from cache
Sourcepub fn clear_cache(&mut self)
pub fn clear_cache(&mut self)
Clear model cache
Sourcepub fn get_model_dimensions(&self, model_name: &str) -> Option<usize>
pub fn get_model_dimensions(&self, model_name: &str) -> Option<usize>
Get model dimensions
Trait Implementations§
Auto Trait Implementations§
impl Freeze for HuggingFaceEmbedder
impl RefUnwindSafe for HuggingFaceEmbedder
impl Send for HuggingFaceEmbedder
impl Sync for HuggingFaceEmbedder
impl Unpin for HuggingFaceEmbedder
impl UnwindSafe for HuggingFaceEmbedder
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.