Skip to main content

Module driver

Module driver 

Source
Expand description

LLM driver abstraction.

Defines the LlmDriver trait — the interface between the agent loop and LLM inference backends. The default implementation is RealizarDriver (sovereign, local GGUF/APR inference).

Modules§

apr_serve
AprServeDriver — first-class inference via apr serve subprocess.
chat_template
Chat template formatting for local LLM inference.
mock
Mock LLM driver for deterministic testing.
realizar
RealizarDriver — sovereign local inference via GGUF/APR models.
remote
Remote HTTP driver for external LLM APIs.
router
Routing driver for local-first, remote fallback inference.
validate
Model file validation (CONTRACT: apr_model_validity).

Structs§

CompletionRequest
Request to the LLM driver.
CompletionResponse
Response from the LLM driver.
ToolCall
A tool call request from the model.
ToolDefinition
Tool definition for the LLM (JSON Schema).
ToolResultMsg
A tool result message.

Enums§

Message
Message in the agent conversation.
StreamEvent
Streaming event from the LLM driver.

Traits§

LlmDriver
Abstraction over LLM inference backends.