Type Alias ExecutionContext

pub type ExecutionContext = ServerStreamingEngine<BackendInput, ExecutionOutputStream>;

Context for executing LLM inference, engine consumes backend input and produces execution output stream

Aliased Type

struct ExecutionContext { /* private fields */ }