Struct Settings 

pub struct Settings {
    pub worker: PathBuf,
    pub model_dir: String,
    pub model_sha256: String,
    pub limits: Limits,
    pub batch: NonZeroUsize,
    pub ready: Duration,
    pub call: Duration,
    pub waiting: usize,
    pub request_items: NonZeroUsize,
    pub page_records: NonZeroUsize,
    pub writer_wait: Duration,
    pub windows: Option<Windows>,
}

The worker, the Start it is sent, and the service’s own bounds on it.

Fields

worker: PathBuf

model_dir: String

model_sha256: String

The model’s manifest a worker’s Ready must name, or it is refused.

limits: Limits

batch: NonZeroUsize

limits.batch_items as a count of texts.

ready: Duration

From Start until Ready.

call: Duration

From each Embed until its Vectors.

waiting: usize

Callers that may wait for the one worker at once.

request_items: NonZeroUsize

Texts one request may ask for.

page_records: NonZeroUsize

Records one page of the walk reads and commits once, from 1 to PAGE_RECORDS_MOST.

writer_wait: Duration

windows: Option<Windows>

EMB-E2: how a text longer than the model reads is embedded whole; None keeps EMB1, where it gets no vector.

Implementations

impl Settings

pub fn document_call(&self) -> Duration

EMB-E2 (h): the most one worker call of documents may take.

With windows on, a text may answer up to max_windows vectors, so the call is given embed_call_ms for each: a page’s calls stay within embed_call_ms × ⌈(texts + windows) / batch⌉ at their most.

Trait Implementations

impl Clone for Settings

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Settings

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.