Skip to main content

Module model

Module model 

Source
Expand description

The chat-model abstraction the agent loop runs against.

Decoupling the loop from a concrete client means: (a) the loop is unit- testable with a scripted mock — no network; (b) any backend (the real LlmClient, a local model, a replay harness) plugs in by implementing one method.

Structs§

ModelDescriptor
Registered model and the request options it supports.
ModelRegistry
Exact-id registry of models a Profile may select.

Enums§

ModelRegistryError
Model registration or resolution failure.

Traits§

ChatModel
Anything that can turn a chat-completion request into a response.