Crate slm_inference 

Re-exports

pub use hf::SlmHfModel;

pub use inference::SlmBoxedBrakeFn;

pub use inference::SlmBrake;

pub use inference::SlmInference;

pub use inference::SlmSimpleInference;

pub use models::SlmDynamicFormatter;

Modules

core

errors

hf

inference

models

Structs

SlmPos

SlmSimpleOracle

Standard SlmOracle implementation backed by any SlmInference engine and any SlmFormatter.

Enums

SlmAnswer

SlmEditLevel

SlmKvType

SlmRole

Traits

SlmBatch

SlmContext

Core inference context that owns a KV cache and provides all token-level operations required for autoregressive text generation.

SlmContextBuilder

SlmFormatter

SlmModel

SlmModelConfig

SlmOracle

High-level interface for interacting with a language model in a conversational manner.

SlmToken