Struct Model 

pub struct Model { /* private fields */ }

Cloneable opaque handle for one exact selected model.

One model owns an exact ModelId, an associated continuation type, and an associated Session type. Requests do not repeat model selection. Caller models remain concrete; supplied Model clones share their Provider lifecycle.

See crate::ProviderBackend for a complete example.

Trait Implementations

impl Clone for Model

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Model

fn fmt(&self, formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl ModelBackend for Model

type Continuation = GenerationContinuation

Opaque model-authored state retained between generation turns.

type Session = Session

Stateful child returned by this model.

fn model_id(&self) -> &ModelId

Exact selected model id.

async fn generate( &self, request: &GenerateRequest<GenerationContinuation>, ) -> Result<GenerateResponse<GenerationContinuation>, KitError>

Runs non-streaming generation.

async fn generate_stream( &self, request: &GenerateRequest<GenerationContinuation>, ) -> Result<GenerateEventStream<GenerationContinuation>, KitError>

Opens a normalized generation stream.

async fn embed(&self, request: &EmbedRequest) -> Result<EmbedResponse, KitError>

Runs embeddings when supported.

async fn submit_batch( &self, request: &BatchSubmitRequest<GenerationContinuation>, ) -> Result<BatchJob, KitError>

Submits a model-bound batch when supported.

async fn open_session(&self, config: SessionConfig) -> Result<Session, KitError>

Opens a stateful model session.