Skip to main content

Module model

Module model 

Source
Expand description

Model configuration and provider compatibility flags.

Structs§

CostConfig
Cost per million tokens (input/output).
ModelConfig
Full model configuration. Knows everything needed to make API calls.
OpenAiCompat
Compatibility flags for OpenAI-compatible providers. Different providers have different quirks even though they share the same base API.
StaticCredentialProvider
Reference implementation of CredentialProvider that always returns a fixed key.

Enums§

ApiProtocol
Which API protocol a model uses.
MaxTokensField
How a provider handles the max_tokens field.
ThinkingFormat
How a provider formats thinking/reasoning output.

Traits§

CredentialProvider
Pluggable source of the API key for a ModelConfig.