Skip to main content

Module engine

Module engine 

Source
Expand description

DecisionEngine trait and token estimation helpers. Decision engine trait definition and token estimation helpers.

Traits§

DecisionEngine
The trait every backend implements. The engine is runtime-agnostic: it doesn’t know it’s being served over HTTP or gRPC — that’s deliberate. Callers pass SystemRequest in and get SystemResponse back.