Struct LocalModel 

pub struct LocalModel {
    pub id: &'static str,
    pub revision: &'static str,
    pub files: &'static [ModelFile],
    pub max_tokens: usize,
    pub architecture: Architecture,
}

A model the local provider can run.

Fields

id: &'static str

Hugging Face repository id.

revision: &'static str

files: &'static [ModelFile]

max_tokens: usize

Longest input in tokens; a longer function is embedded by its head.

architecture: Architecture

Implementations

impl LocalModel

pub fn dir(&self, cache_root: &Path) -> PathBuf

Where the files live: <cache>/models/<owner>--<name>/<revision>.

pub fn size(&self) -> u64

Total download size in bytes.

pub fn is_downloaded(&self, dir: &Path) -> bool

Whether every file is in dir, verified. A download stamps the directory once every file’s SHA-256 matched; files that have their pinned sizes but no stamp (copied in by hand, or left by an earlier build) are hashed once here, and stamped when they match. A size alone proves nothing: an interrupted or overlapping download can leave a file of the right size with the wrong bytes.

pub fn is_stamped(&self, dir: &Path) -> bool

Whether every file in dir has its pinned size and the directory carries this model’s stamp. Unlike Self::is_downloaded, it never hashes a file or writes a stamp, so it is cheap enough for a listing.

pub fn download( &self, dir: &Path, agent: &Agent, quiet: bool, ) -> Result<(), String>

Download the files missing from dir, checking size and checksum.

Trait Implementations

impl Debug for LocalModel

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.