Struct InferenceContext 

pub struct InferenceContext {
    pub system_context: Vec<String>,
    pub session_context: Vec<String>,
    pub tools: Vec<ToolDescriptor>,
    pub request_transforms: Vec<Arc<dyn InferenceRequestTransform>>,
}

Inference-phase extension: system/session context and tool descriptors.

Populated by AddSystemContext, AddSessionContext, ExcludeTool, IncludeOnlyTools, AddRequestTransform actions during BeforeInference.

Fields

system_context: Vec<String>

System context lines appended to the system prompt.

session_context: Vec<String>

Session context messages injected before user messages.

tools: Vec<ToolDescriptor>

Available tool descriptors (can be filtered by actions).

request_transforms: Vec<Arc<dyn InferenceRequestTransform>>

Request transforms registered by plugins. Applied in order after messages are assembled, before the request is sent to the LLM.

Trait Implementations

impl Clone for InferenceContext

fn clone(&self) -> InferenceContext

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceContext

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for InferenceContext

fn default() -> InferenceContext

Returns the “default value” for a type.