Skip to main content

Module llm

Module llm 

Source
Expand description

LLM backend abstraction (ADR 0016; an engine module since ADR 0018).

Nothing else in the engine may reach into subprocess machinery: grouping and the pipeline consume only LlmBackend/CommandBackend from here.

The grouping stage needs exactly one capability from a model: one-shot text completion — prompt in, raw text out. The contract is deliberately that narrow: no streaming, no chat state, no conversation to manage.

It stays that narrow now that the model reads for itself (ADR 0022). Tools run inside the CLI this spawns, so what crosses this seam is still a prompt and a string. What changed is a flag in the argv below, not the trait.

Structs§

CommandBackend
A subprocess backend: prompt on stdin, completion on stdout.

Enums§

LlmError

Traits§

LlmBackend
One-shot completion: prompt in, raw text out.