Skip to main content

Module model

Module model 

Source

Structs§

CostTier
A pricing tier that activates above a context token threshold. For example, OpenAI charges higher rates for prompts exceeding 200K tokens.
Model
LLM Model entity
ModelCost
Cost information for the model (per million tokens)
ModelLimits
Token limits for the model
ModelModalities
Model modalities for input and output
ModelProfile
LLM Model Profile describing model capabilities Based on models.dev structure (https://models.dev/api.json)
ModelWithProvider
LLM Model with provider info
ReasoningEffortConfig
Reasoning effort configuration for a model
ReasoningEffortValue
Named reasoning effort value for UI display
SpeedConfig
Speed configuration for a model
SpeedValue
Named speed value for UI display
VerbosityConfig
Verbosity configuration for a model
VerbosityValue
Named verbosity value for UI display

Enums§

DriverId
LLM provider type identifier.
Modality
Modality type (text, image, audio, video)
ModelSource
How the model was added to the system
ModelVendor
Vendor / brand that authored a model. Independent of the provider type that serves it (the same model may be offered by several providers or gateways). Primarily drives UI iconography.
ProviderStatus
LLM provider status
ReasoningEffort
Reasoning effort level for models that support it
Speed
Speed level for models that expose a latency/price service tier. Wire values map 1:1 to the OpenAI service_tier request parameter: flex (slower, cheaper), default (standard), priority (faster, premium). auto is deliberately not offered — omitting the field preserves the provider’s default routing.
Verbosity
Verbosity level for models that support output-length control. Wire values map 1:1 to the OpenAI verbosity request parameter: low (terse), medium (balanced, provider default), high (comprehensive). Independent of ReasoningEffort, which tunes the amount of reasoning rather than the length of the final answer.