Skip to main content

Module streamfn

Module streamfn 

Source
Expand description

LLM stream-function seam + default rig (OpenAI-compatible) adapter.

This module is the only place rig types appear in the kernel. A StreamFn turns harness conversation context into a LlmStream of LlmStreamEvents; rig_stream_fn is the default implementation built on rig’s Chat Completions API client.

Structs§

LlmOpts
RetryPolicy
Retry policy for a stream call: the transient-connect retries plus the stall (idle / time-to-first-token) timeouts.

Enums§

LlmEndpoint

Functions§

list_models
List models via GET {base_url}/models using the same client config as streaming. Ids are sorted for stable display. The endpoint only returns id/name metadata — no capability flags — so effort support stays user-managed.
rig_stream_fn
Default adapter: OpenAI-compatible Chat Completions endpoint via rig.

Type Aliases§

LlmStream
StreamFn