Struct InferenceConfig 

pub struct InferenceConfig {
    pub models_dir: PathBuf,
    pub state_root: PathBuf,
    pub device: Option<Device>,
    pub generation_model: String,
    pub preferred_generation_model: Option<String>,
    pub embedding_model: String,
    pub preferred_embedding_model: Option<String>,
    pub classification_model: String,
    pub preferred_classification_model: Option<String>,
}

Configuration for the inference engine.

Fields

models_dir: PathBuf

Where to store downloaded models. Defaults to ~/.car/models/

This is a machine-global weight cache, NOT per-daemon state: it stays shared even when CAR_HOME relocates a daemon. Anything CAR writes about itself belongs under state_root instead.

state_root: PathBuf

CAR state root: $CAR_HOME, else ~/.car.

Everything the engine persists about itself — the routing outcome profiles, the receipt ledger, key-pool stats, the signed-catalog cache, the discovery cache, the user models.json — hangs off this. Two daemons with different roots therefore keep separate bookkeeping while still sharing the multi-gigabyte weights in models_dir. With CAR_HOME unset this is ~/.car, exactly where all of those files already are.

device: Option<Device>

Device override. None = auto-detect.

generation_model: String

Default model for generation tasks.

preferred_generation_model: Option<String>

Optional preferred model override for generation tasks.

embedding_model: String

Default model for embedding tasks.

preferred_embedding_model: Option<String>

Optional preferred model override for embedding tasks.

classification_model: String

Default model for classification tasks.

preferred_classification_model: Option<String>

Optional preferred model override for classification tasks.

Implementations

impl InferenceConfig

pub fn state_models_dir(&self) -> PathBuf

Engine state that has always lived beside the weights, kept at the same relative path (models/) but anchored at state_root: the outcome profiles, the receipt ledger, key-pool stats, benchmark priors, the discovery cache.

Identical to models_dir whenever CAR_HOME is unset — which is why no existing install’s files move — and a separate, per-daemon directory once it is set.

Trait Implementations

impl Clone for InferenceConfig

fn clone(&self) -> InferenceConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for InferenceConfig

fn default() -> Self

Returns the “default value” for a type.