Struct Builder 

pub struct Builder { /* private fields */ }

Settings for Kime, from Kime::builder.

Implementations

impl Builder

pub fn model(self, name: impl Into<String>) -> Self

The model: an alias such as laya, a checkpoint directory, a .kime file or an hf://org/repo[/subfolder] reference. See hub.

pub fn device(self, d: Device) -> Self

Where to run.

pub fn precision(self, p: Precision) -> Self

The number format on a GPU.

pub fn preload(self, yes: bool) -> Self

Builds the plans for the smallest batch shapes now, so the first requests do not pay for them.

pub fn answer_cache(self, entries: usize) -> Self

Keeps the answers to about entries questions, so the same question on the same state is answered again without the device. 0, the default, keeps none.

pub fn build(self) -> Result<Kime, Error>

Loads the model onto the device.

Errors

When the model is not found or does not load, or the device cannot be opened.

Trait Implementations

impl Clone for Builder

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Builder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Builder

fn default() -> Self

Returns the “default value” for a type.