Module runtime_trait 

Core trait and types for model runtime abstraction

Structs

ChatMessage

InferenceRequest

Inference request (OpenAI-compatible format)

InferenceResponse

Inference response

RuntimeConfig

Runtime configuration for model initialization

RuntimeMetadata

Runtime metadata

Enums

ModelFormat

Supported model formats

Traits

ModelRuntime

Model runtime trait - all runtime adapters must implement this