Module model

Module model 

Source
Expand description

Model Provider Abstraction Layer

This module defines the core traits and types for integrating with various LLM providers. It provides a unified interface that abstracts away provider-specific details.

Structs§

GenerationConfig
Configuration for model generation requests
ModelResponse
Response from a model generation request
ProviderMetadata
Provider metadata
TokenUsage
Token usage statistics
ToolCall
Tool call from a model response

Enums§

ProviderKind
Types of model providers

Traits§

ModelProvider
Core trait that all model providers must implement

Functions§

parse_thinking_tokens
Parse thinking/reasoning tokens from model response