Skip to main content

Module response

Module response 

Source
Expand description

Normalized LLM response types produced by response codecs.

This module defines AnnotatedLlmResponse and its supporting types for structured, API-agnostic access to LLM response data.

Structs§

AnnotatedLlmResponse
Structured view of an LLM response, produced by a response codec from raw JSON API output.
ResponseToolCall
A tool call requested by the model in its response.
Usage
Token usage statistics from an LLM API response.

Enums§

ApiSpecificResponse
API-specific response data that cannot be normalized across providers.
FinishReason
Normalized reason why the model stopped generating.