Struct Options 

pub struct Options {

    pub worker: Setting<PathBuf>,
    pub model_dir: Setting<PathBuf>,
    pub model_sha256: Setting<String>,
    pub memory_bytes: Setting<u64>,
    pub threads: Setting<u64>,
    pub batch_items: Setting<u64>,
    pub input_bytes: Setting<u64>,
    pub tokens: Setting<u64>,
    pub frame_bytes: Setting<u32>,
    pub ready_ms: Setting<u64>,
    pub call_ms: Setting<u64>,
    pub waiting: Setting<u64>,
    pub request_items: Setting<u64>,
    pub page_records: Setting<u64>,
    pub writer_wait_ms: Setting<u64>,
    pub windows: Setting<bool>,
    pub max_windows: Setting<u64>,
    pub overlap_tokens: Setting<u64>,
}

The keys as serve.json gives them; all absent turns embedding off.

Fields

worker: Setting<PathBuf>

model_dir: Setting<PathBuf>

model_sha256: Setting<String>

memory_bytes: Setting<u64>

threads: Setting<u64>

batch_items: Setting<u64>

input_bytes: Setting<u64>

tokens: Setting<u64>

frame_bytes: Setting<u32>

ready_ms: Setting<u64>

call_ms: Setting<u64>

waiting: Setting<u64>

request_items: Setting<u64>

page_records: Setting<u64>

writer_wait_ms: Setting<u64>

windows: Setting<bool>

EMB-E2: embed_windows; off when absent.

max_windows: Setting<u64>

EMB-E2: embed_max_windows; MAX_WINDOWS when absent.

overlap_tokens: Setting<u64>

EMB-E2: embed_window_overlap_tokens; OVERLAP_TOKENS when absent.

Implementations

impl Options

pub fn resolve(self) -> Result<Option<Settings>, String>

The settings, None when no key is given.

Errors

Names every missing key when only some are given, and any key whose value the worker’s Start or the service cannot take.

Trait Implementations

impl Clone for Options

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Options

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Options

fn default() -> Self

Returns the “default value” for a type.