Expand description
Re-exported plugin-neutral LLM optimization data types.
Structs§
- LlmOptimization
Contribution - One optimizer’s evidence for a change to an LLM call.
- LlmOptimization
Kind - Open, forward-compatible optimization classification.
- LlmOptimization
Model - Model identity used for counterfactual and effective pricing.
- LlmOptimization
Model Transition - A model change proposed or applied by an optimizer.
- LlmOptimization
Summary - Close-time accounting attached to the normalized LLM response.
- LlmOptimization
Token Impact - Shared token evidence that Relay can aggregate without understanding a plugin payload.
- LlmOptimization
Tokens - Token quantities retained independently from pricing arithmetic.
Enums§
- LlmOptimization
Evidence Quality - Whether token evidence was observed directly or estimated.
- LlmOptimization
Summary Status - Completeness of close-time optimization accounting.
Traits§
- LlmOptimization
Payload - Trait implemented by typed plugin payloads embedded in an optimization contribution.