Skip to main content

Module provider

Module provider 

Source
Expand description

The model provider interface.

Everything vendor-specific lives behind ModelProvider. The interpreter builds a CompletionRequest from the IR and never learns which provider answered it.

Structs§

CompletionRequest
One model call.
CompletionResponse
Usage

Enums§

ModelSelection
Which model to use, as the artifact stated it.
ProviderError

Traits§

ModelProvider
A source of model completions.

Type Aliases§

DeltaSink
Text as it arrives, handed over before the answer is complete.