Expand description
LLM codec types, traits, and built-in implementations.
This module provides the type system and traits for bidirectional
request codecs (traits::LlmCodec / request::AnnotatedLlmRequest),
the decode-only response codec
(traits::LlmResponseCodec / response::AnnotatedLlmResponse), and
the streaming response codec
(streaming::StreamingCodec) used with the managed
streaming LLM execution pipeline.
Modulesยง
- anthropic
- Built-in codec for the Anthropic Messages API.
- openai_
chat - Built-in codec for the OpenAI Chat Completions API.
- openai_
responses - Built-in codec for the OpenAI Responses API.
- request
- LLM request codec types and trait.
- response
- Normalized LLM response types produced by response codecs.
- streaming
- Streaming response codecs for the managed LLM execution pipeline.
- traits
- LLM codec traits for bidirectional request translation.