Skip to main content

Module model

Module model 

Source

Structs§

FallbackModel
Tries each model in order. Moves on when a request fails with a retryable error or when the answer is unusable:
ModelRequest
ModelResponse
RejectedAttempt
A model answer that was received, paid for, and discarded.
Usage

Enums§

ModelError
StopReason
StreamEvent
Incremental output from a streaming model call.

Traits§

Model

Functions§

synthesize_stream
Express a complete response as the deltas a streaming call would yield.

Type Aliases§

ModelStream