Struct rphi::PhiSource

pub struct PhiSource { /* private fields */ }

A PhiSource is the source to fetch a Phi-1.5 model from. The model to use, check out available models: https://huggingface.co/models?other=mixformer-sequential&sort=trending&search=phi The model must have a quantized version available with a safetensors file. (for example lmz/candle-quantized-phi)

Implementations

impl PhiSource

pub fn new(model_id: String) -> Self

Create a new PhiSource with the given model id.

pub fn v1() -> Self

The phi-v1 model.

pub fn v1_5() -> Self

The phi-1.5 model.

pub fn v2() -> Self

The phi-2 model.

pub fn puffin_phi_v2() -> Self

The puffin model based on phi-1.5.

pub fn dolphin_phi_v2() -> Self

The dolphin model based on phi-2.

pub fn with_revision(self, revision: String) -> Self

Set the revision to use for the model.

pub fn with_model_file(self, model_file: String) -> Self

Set the model file to use for the model.

pub fn with_tokenizer_file(self, tokenizer_file: String) -> Self

Set the tokenizer file to use for the model.

pub fn with_phi_config(self, phi_config: Config) -> Self

Set the phi config to use for the model.

pub fn with_chat_markers(self, chat_markers: ChatMarkers) -> Self

Set the chat markers to use for the model.

Trait Implementations

impl Default for PhiSource

fn default() -> Self

Returns the “default value” for a type.