Struct ModelAdapter 

pub struct ModelAdapter<Op: Operation> { /* private fields */ }

A model as a handler under label. Completion, text-embedding and rerank models serve their effect families. The model is erased to its operation, so one adapter type serves every wire and transport.

Implementations

impl<Op: Operation> ModelAdapter<Op>

pub fn new(label: impl Into<ModelRef>, model: impl Into<DynModel<Op>>) -> Self

Wrap model under label.

Trait Implementations

impl Serve for ModelAdapter<Completion>

Unary and streaming completions both route here; the descriptor carries the model’s label and capability snapshot.

fn check(&self, kind: &EffectKind) -> Vec<UnsupportedOption>

What the model’s wire or the model leaves out of a completion’s request (DynModel::check); nothing for a request that cannot be built at all, which sending reports, or for another family. The check reads no messages but the system prompt, so the answer for the last request is kept for the next that differs only in its messages. A request with provider options is always checked: two equal entries can still refuse differently.

type Family = Completion

The family this handler serves, or Dynamic.

fn descriptor(&self) -> HandlerDescriptor

What this handler is: the family-keyed description a typed view checks at bind time and a scene serializes.

async fn serve(&self, kind: EffectKind, dispatch: Dispatch) -> Reply

Prepare an outcome or an owned stream for the driver to consume.

fn key(&self) -> HandlerKey

The descriptor’s key. A handler whose descriptor is costly to build, such as a tool’s argument schema, says it without building one.

fn footprint(&self, kind: &EffectKind) -> Option<Touches>

What dispatching kind may read and change, for a tool’s handler (Tool::footprint); None when it cannot say, such as for arguments that do not parse.

impl Serve for ModelAdapter<Embedding>

A text embedding model embeds texts and refuses images.

type Family = Embed

The family this handler serves, or Dynamic.

fn descriptor(&self) -> HandlerDescriptor

What this handler is: the family-keyed description a typed view checks at bind time and a scene serializes.

async fn serve(&self, kind: EffectKind, dispatch: Dispatch) -> Reply

Prepare an outcome or an owned stream for the driver to consume.

fn key(&self) -> HandlerKey

The descriptor’s key. A handler whose descriptor is costly to build, such as a tool’s argument schema, says it without building one.

fn footprint(&self, kind: &EffectKind) -> Option<Touches>

What dispatching kind may read and change, for a tool’s handler (Tool::footprint); None when it cannot say, such as for arguments that do not parse.

fn check(&self, kind: &EffectKind) -> Vec<UnsupportedOption>

The options of kind this handler would leave out when it serves it, with nothing sent: for a model’s handler, what its wire or model cannot honour (DynModel::check). Empty when it leaves nothing out or cannot say, as by default.

impl Serve for ModelAdapter<Rerank>

A reranking model orders documents for a query.

type Family = Rerank

The family this handler serves, or Dynamic.

fn descriptor(&self) -> HandlerDescriptor

What this handler is: the family-keyed description a typed view checks at bind time and a scene serializes.

async fn serve(&self, kind: EffectKind, dispatch: Dispatch) -> Reply

Prepare an outcome or an owned stream for the driver to consume.

fn key(&self) -> HandlerKey

The descriptor’s key. A handler whose descriptor is costly to build, such as a tool’s argument schema, says it without building one.

fn footprint(&self, kind: &EffectKind) -> Option<Touches>

What dispatching kind may read and change, for a tool’s handler (Tool::footprint); None when it cannot say, such as for arguments that do not parse.

fn check(&self, kind: &EffectKind) -> Vec<UnsupportedOption>

The options of kind this handler would leave out when it serves it, with nothing sent: for a model’s handler, what its wire or model cannot honour (DynModel::check). Empty when it leaves nothing out or cannot say, as by default.