Skip to main content

Module codec

Module codec 

Source
Expand description

LLM codec types, traits, and built-in implementations.

This module provides the type system and traits for bidirectional request codecs (traits::LlmCodec / request::AnnotatedLlmRequest), the decode-only response codec (traits::LlmResponseCodec / response::AnnotatedLlmResponse), and the streaming response codec (streaming::StreamingCodec) used with the managed streaming LLM execution pipeline.

resolve is the detect-then-decode entry point for selecting a built-in provider codec from a raw payload when no codec annotation is present.

Modulesยง

anthropic
Built-in codec for the Anthropic Messages API.
model_pricing
Data-driven LLM model pricing used to layer cost estimates onto usage.
openai_chat
Built-in codec for the OpenAI Chat Completions API.
openai_responses
Built-in codec for the OpenAI Responses API.
optimization
Re-exported plugin-neutral LLM optimization data types.
request
Re-exported normalized LLM request data types.
resolve
Provider-surface detection, best-effort normalization, and construction of the matching built-in codecs from a raw payload, surface, or codec name.
response
Re-exported normalized LLM response data types and core pricing helpers.
streaming
Streaming response codecs for the managed LLM execution pipeline.
traits
LLM codec traits for bidirectional request translation.