Struct AdaptiveHintsIntercept 

pub struct AdaptiveHintsIntercept { /* private fields */ }

Opt-in LLM request intercept that injects AgentHints into request headers from the prediction trie in HotCache.

Constructed via AdaptiveHintsIntercept::new and converted to an LlmRequestInterceptFn via AdaptiveHintsIntercept::into_request_fn for registration with the NeMo Flow runtime.

Implementations

impl AdaptiveHintsIntercept

pub fn new(hot_cache: Arc<RwLock<HotCache>>, agent_id: String) -> Self

Creates a new AdaptiveHintsIntercept.

pub fn into_request_fn(self) -> LlmRequestInterceptFn

Converts this intercept into an LlmRequestInterceptFn suitable for registration with [register_llm_request_intercept].

The returned closure reads the HotCache trie, builds AgentHints, injects them into the request headers and body, and returns the transformed request.