Expand description
Shared public data types for plugin boundaries.
Structs§
- Cache
Breakpoint - Cache breakpoint position in the request, for prompt cache optimization.
- Cache
Score - Cache utility prediction for routing decisions.
- Internal
Error - Internal error information with stage and kind details.
- Plugin
Manifest - Plugin manifest passed to runtime adapters when instantiating plugins.
- Principal
- Authenticated caller identity used for quota, audit, and routing decisions.
- Principal
Quotas - Per-principal quota window and model allow-list.
- Rate
Limit Observation - Latest upstream rate-limit observation exposed to router plugins.
- Request
Context - Parsed downstream request data passed into plugins.
- Route
Decision - Router output selecting both an upstream and its dialect boundary object.
- Routing
Trace - Complete routing trace for a request through all decision stages.
- Shaped
Request - Request produced by an upstream dialect before credentials are applied.
- Shaped
Request Builder - Dialect-facing capability used to construct shaped requests.
- Signed
Request - Request after a signer has consumed and sealed a shaped request.
- Signing
Capability - Signer-facing capability used to seal shaped requests.
- Stage
Decision - Decision made at a single routing stage.
- Subscription
Quota Candidate Snapshot - Latest subscription quota snapshot for one candidate/window.
- Terminal
Decision - Terminal routing decision selecting an upstream.
- Upstream
Candidate - Available upstream candidate for routing decisions.
- Warm
Cache Entry - Warm cache entry eligible for reuse in upstream requests.
Enums§
- Breakpoint
Origin - Origin of a cache breakpoint: whether explicitly requested or auto-inferred.
- Cache
Breakpoint Source - Source of a cache breakpoint within the request.
- Credential
Strategy - Credential strategy expected by a selected upstream.
- Internal
Error Kind - Kind of internal error that occurred.
- Internal
Error Stage - Stage where an internal error occurred.
- Observe
Event - Observability events emitted by the lifecycle.
- Passthrough
Cause - Reason for a passthrough routing decision.
- PerCandidate
Reason - Per-candidate evaluation reason.
- Plugin
Slot - Runtime chain slot a plugin can provide.
- Principal
Kind - Principal categories supported by first-party and custom auth plugins.
- Rate
Limit Kind - Upstream rate-limit metric kind observed from upstream responses.
- Retry
Decision - Decision returned by a signer after receiving an unauthorized upstream error.
- Subscription
Quota Data State - Freshness state for subscription quota data exposed to router plugins.
- Terminal
Strategy - Strategy for selecting a terminal upstream.
- TtlClass
- Prompt cache TTL class: immutable after entry creation.
- Upstream
- Upstream backends supported by the proxy routing contract.
- Upstream
Kind - Upstream record kind exposed to router plugins for candidate selection.
Constants§
- MAX_
ERROR_ MESSAGE_ LEN - Maximum length of an error message in internal errors.
- MAX_
ROUTING_ TRACE_ STAGES - Maximum number of stages in a routing trace.
- MAX_
STAGE_ NAME_ LEN - Maximum length of a stage name.
Functions§
- shape_
request - Invokes an upstream dialect with a temporary shaped-request capability.
- sign_
request - Invokes a signer with a temporary signing capability.