Skip to main content

Module optimization

Module optimization 

Source
Expand description

Re-exported plugin-neutral LLM optimization data types.

Structs§

LlmOptimizationContribution
One optimizer’s evidence for a change to an LLM call.
LlmOptimizationKind
Open, forward-compatible optimization classification.
LlmOptimizationModel
Model identity used for counterfactual and effective pricing.
LlmOptimizationModelTransition
A model change proposed or applied by an optimizer.
LlmOptimizationSummary
Close-time accounting attached to the normalized LLM response.
LlmOptimizationTokenImpact
Shared token evidence that Relay can aggregate without understanding a plugin payload.
LlmOptimizationTokens
Token quantities retained independently from pricing arithmetic.

Enums§

LlmOptimizationEvidenceQuality
Whether token evidence was observed directly or estimated.
LlmOptimizationSummaryStatus
Completeness of close-time optimization accounting.

Traits§

LlmOptimizationPayload
Trait implemented by typed plugin payloads embedded in an optimization contribution.