Skip to main content

Module models

Module models 

Source
Expand description

Model catalog from CodeTether API

Fetches model information from the “models” endpoint for each provider, including capabilities, costs, and limits. This is used to enrich our internal model information and provide better recommendations and cost estimates. The catalog is fetched on demand and cached in memory. It also integrates with the secrets manager to check which providers have API keys configured, allowing us to filter available models accordingly.

Structs§

ApiModelInfo
Model information from the API
ModelCatalog
Model catalog for looking up models
ModelCost
Model cost information (per million tokens)
ModelLimit
Model limits
ModelModalities
Model modalities
ProviderInfo
Provider information

Type Aliases§

ModelsApiResponse
The full API response