Struct SessionOptions 

pub struct SessionOptions {
    pub n_threads: i32,
    pub kv_type: KvType,
    pub n_ctx: i32,
}

Options for creating a session.

Fields

n_threads: i32

CPU threads for ops that run on CPU; 0 = library default.

kv_type: KvType

K/V activation precision.

n_ctx: i32

Optional decoder context cap in tokens; 0 = model maximum.

Trait Implementations

impl Clone for SessionOptions

fn clone(&self) -> SessionOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SessionOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SessionOptions

fn default() -> Self

Returns the “default value” for a type.

impl Eq for SessionOptions

impl PartialEq for SessionOptions

fn eq(&self, other: &SessionOptions) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SessionOptions