Struct ModelOptions 

pub struct ModelOptions {
    pub backend: Backend,
    pub device: Option<Device>,
    pub no_mmap: bool,
}

Options for loading a model.

Fields

backend: Backend

Which backend to request. Default Backend::Auto. An explicit device must match a non-Auto backend request.

device: Option<Device>

Exact process-local compute device. None applies the backend’s automatic policy; Some selects that device or fails without fallback.

no_mmap: bool

Copy the weights into memory instead of memory-mapping the model file. Default false: where the device can use host memory (CPU, Metal on Apple silicon) the weights are served from the file’s page cache, which the OS can reclaim. Don’t truncate or rewrite a mapped model file in place; write a new file and rename it over the old one. The TRANSCRIBE_NO_MMAP=1 environment variable forces true.

Trait Implementations

impl Clone for ModelOptions

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ModelOptions

fn default() -> Self

Returns the “default value” for a type.

impl Eq for ModelOptions

impl PartialEq for ModelOptions

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ModelOptions