Expand description
Local-LLM distillation trait and the optional distill-http implementation.
Distillation: turning a raw conversation transcript into durable memory.
This module defines the Distiller trait and the data types it
produces. The trait itself is always available (not feature-gated) so
that callers can implement their own distillers — for example, a remote
API client, a different local model runtime, or a test stub.
The OpenAiCompatDistiller implementation in the openai_compat
submodule (behind the distill-http feature) talks to an
OpenAI-compatible chat completions endpoint such as Ollama or
llama-server. It is the only place in this crate that performs HTTP, and
only when that feature is enabled.
Structs§
- Distilled
Memory - The result of distilling a conversation transcript into durable memory.
- Fact
- A single distilled fact extracted from a transcript.
Enums§
Traits§
- Distiller
- Produces
DistilledMemoryfrom a raw conversation transcript.