pub struct CandlePhiEngine { /* private fields */ }Expand description
Candle-based Phi-3 enrichment engine using quantized GGUF.
Implementations§
Source§impl CandlePhiEngine
impl CandlePhiEngine
Sourcepub fn from_hub(repo: Option<&str>) -> Self
pub fn from_hub(repo: Option<&str>) -> Self
Create a new Candle Phi engine that loads from Hugging Face Hub.
Sourcepub fn from_local(path: PathBuf) -> Self
pub fn from_local(path: PathBuf) -> Self
Create a new Candle Phi engine that loads from a local GGUF file.
Sourcepub fn from_memvid_models(models_dir: PathBuf) -> Self
pub fn from_memvid_models(models_dir: PathBuf) -> Self
Create a new Candle Phi engine that uses the memvid models directory. Downloads the model to ~/.memvid/models/llm/phi-3-mini-q4/ if not present.
Trait Implementations§
Source§impl EnrichmentEngine for CandlePhiEngine
impl EnrichmentEngine for CandlePhiEngine
Source§fn enrich(&self, ctx: &EnrichmentContext) -> EnrichmentResult
fn enrich(&self, ctx: &EnrichmentContext) -> EnrichmentResult
Process a frame and extract memory cards. Read more
Auto Trait Implementations§
impl !Freeze for CandlePhiEngine
impl RefUnwindSafe for CandlePhiEngine
impl Send for CandlePhiEngine
impl Sync for CandlePhiEngine
impl Unpin for CandlePhiEngine
impl UnwindSafe for CandlePhiEngine
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
Source§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Converts
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>, which can then be
downcast into Box<dyn ConcreteType> where ConcreteType implements Trait.Source§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Converts
Rc<Trait> (where Trait: Downcast) to Rc<Any>, which can then be further
downcast into Rc<ConcreteType> where ConcreteType implements Trait.Source§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Converts
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.Source§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Converts
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.Source§impl<T> DowncastSend for T
impl<T> DowncastSend for T
Source§impl<T> DowncastSync for T
impl<T> DowncastSync for T
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more