pub struct PyTorchEmbedder { /* private fields */ }Expand description
PyTorch-shaped embedding generator — currently a deterministic mock,
not real PyTorch inference. See the pytorch module-level docs.
Implementations§
Source§impl PyTorchEmbedder
impl PyTorchEmbedder
Sourcepub fn new(config: PyTorchConfig) -> Result<Self>
pub fn new(config: PyTorchConfig) -> Result<Self>
Create a new PyTorch embedder
Sourcepub fn load_model(&mut self) -> Result<()>
pub fn load_model(&mut self) -> Result<()>
“Load” a PyTorch model from file.
This does not actually load or run a PyTorch model. It only
verifies model_path exists on disk, then populates
PyTorchModelMetadata with hardcoded values; no weights are read
and no tch/candle-core runtime is invoked. See the module-level
docs. Real inference calls (Self::embed_text,
Self::embed_batch) log a warning the first time they run against
a model “loaded” this way.
Sourcepub fn embed_text(&self, text: &str) -> Result<Vector>
pub fn embed_text(&self, text: &str) -> Result<Vector>
Generate embeddings for text
Sourcepub fn embed_batch(&self, texts: &[String]) -> Result<Vec<Vector>>
pub fn embed_batch(&self, texts: &[String]) -> Result<Vec<Vector>>
Generate embeddings for multiple texts
Sourcepub fn get_metadata(&self) -> Option<&PyTorchModelMetadata>
pub fn get_metadata(&self) -> Option<&PyTorchModelMetadata>
Get model metadata
Sourcepub fn get_dimensions(&self) -> Option<usize>
pub fn get_dimensions(&self) -> Option<usize>
Get embedding dimensions
Sourcepub fn set_tokenizer(&mut self, tokenizer: PyTorchTokenizer)
pub fn set_tokenizer(&mut self, tokenizer: PyTorchTokenizer)
Update tokenizer
Sourcepub fn supports_mixed_precision(&self) -> bool
pub fn supports_mixed_precision(&self) -> bool
Check if model supports mixed precision
Sourcepub fn get_device(&self) -> &PyTorchDevice
pub fn get_device(&self) -> &PyTorchDevice
Get current device
Trait Implementations§
Source§impl Debug for PyTorchEmbedder
impl Debug for PyTorchEmbedder
Source§impl EmbeddingGenerator for PyTorchEmbedder
impl EmbeddingGenerator for PyTorchEmbedder
Source§fn generate_embedding(&self, content: &ContentItem) -> Result<Vector>
fn generate_embedding(&self, content: &ContentItem) -> Result<Vector>
Source§fn generate_batch_embeddings(
&self,
content: &[ContentItem],
) -> Result<Vec<ProcessingResult>>
fn generate_batch_embeddings( &self, content: &[ContentItem], ) -> Result<Vec<ProcessingResult>>
Source§fn embedding_dimensions(&self) -> usize
fn embedding_dimensions(&self) -> usize
Source§fn get_config(&self) -> Value
fn get_config(&self) -> Value
Source§fn get_statistics(&self) -> GeneratorStatistics
fn get_statistics(&self) -> GeneratorStatistics
Auto Trait Implementations§
impl Freeze for PyTorchEmbedder
impl RefUnwindSafe for PyTorchEmbedder
impl Send for PyTorchEmbedder
impl Sync for PyTorchEmbedder
impl Unpin for PyTorchEmbedder
impl UnsafeUnpin for PyTorchEmbedder
impl UnwindSafe for PyTorchEmbedder
Blanket Implementations§
Source§impl<'a, T, E> AsTaggedExplicit<'a, E> for Twhere
T: 'a,
impl<'a, T, E> AsTaggedExplicit<'a, E> for Twhere
T: 'a,
Source§impl<'a, T, E> AsTaggedImplicit<'a, E> for Twhere
T: 'a,
impl<'a, T, E> AsTaggedImplicit<'a, E> for Twhere
T: 'a,
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> Read<Exclusive, BecauseExclusive> for Twhere
T: ?Sized,
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
self to the equivalent element of its superset.