Expand description
Optional proxy-cache hook consulted by the evaluation handlers. Optional proxy-cache hook for the evaluation handlers.
When the daemon runs with --proxy-cache-upstream, it builds a
SystemProxy implementation and stores it on [AppState]. The HTTP
handler consults the hook before dispatching to the local registry, so
proxied model aliases can be answered from the distilling cache or
forwarded to the upstream Jev API with the caller’s own credentials.
The trait lives here so openkind-api never depends on the server or
backends crates; the daemon supplies the implementation.
Structs§
- Proxy
Outcome - The outcome of a proxied evaluation.
Enums§
- Proxy
Source - Where a proxied answer came from.
Traits§
- System
Proxy - The proxy-cache hook the daemon installs.