Expand description
DecisionEngine trait and token estimation helpers. Decision engine trait definition and token estimation helpers.
Traits§
- Decision
Engine - The trait every backend implements. The engine is runtime-agnostic:
it doesn’t know it’s being served over HTTP or gRPC — that’s deliberate.
Callers pass
SystemRequestin and getSystemResponseback.