Expand description
LLM codec types, traits, and built-in implementations.
This module provides the type system and traits for bidirectional
request codecs (traits::LlmCodec / request::AnnotatedLlmRequest),
the decode-only response codec
(traits::LlmResponseCodec / response::AnnotatedLlmResponse), and
the streaming response codec
(streaming::StreamingCodec) used with the managed
streaming LLM execution pipeline.
resolve is the detect-then-decode entry point for selecting a built-in
provider codec from a raw payload when no codec annotation is present.
Modulesยง
- anthropic
- Built-in codec for the Anthropic Messages API.
- model_
pricing - Data-driven LLM model pricing used to layer cost estimates onto usage.
- openai_
chat - Built-in codec for the OpenAI Chat Completions API.
- openai_
responses - Built-in codec for the OpenAI Responses API.
- optimization
- Re-exported plugin-neutral LLM optimization data types.
- request
- Re-exported normalized LLM request data types.
- resolve
- Provider-surface detection, best-effort normalization, and construction of the matching built-in codecs from a raw payload, surface, or codec name.
- response
- Re-exported normalized LLM response data types and core pricing helpers.
- streaming
- Streaming response codecs for the managed LLM execution pipeline.
- traits
- LLM codec traits for bidirectional request translation.