Crate nemo_flow_adaptive 

NeMo Flow Adaptive

Adaptive config helpers and core-plugin integration for NeMo Flow. Adaptive behavior is enabled through the generic core plugin system.

This crate provides the adaptive runtime, persistence abstractions, learner implementations, and Adaptive Cache Governor (ACG) analysis types used to derive and apply runtime hints from observed NeMo Flow executions.

Re-exports

pub use config::AcgComponentConfig;

pub use config::AdaptiveConfig;

pub use config::AdaptiveHintsComponentConfig;

pub use config::BackendSpec;

pub use config::StateConfig;

pub use config::TelemetryComponentConfig;

pub use config::ToolParallelismComponentConfig;

pub use context_helpers::LATENCY_SENSITIVITY_POINTER;

pub use context_helpers::extract_scope_path;

pub use context_helpers::read_manual_latency_sensitivity;

pub use context_helpers::resolve_agent_id;

pub use context_helpers::resolve_shared_parent_scope_identity;

pub use context_helpers::set_latency_sensitivity;

pub use error::AdaptiveError;

pub use error::Result;

pub use storage::erased::AnyBackend;

pub use storage::memory::InMemoryBackend;

pub use storage::traits::StorageBackend;

pub use storage::traits::StorageBackendDyn;

Modules

acg

Canonical Adaptive Cache Governor (ACG) module surface exposed from the adaptive crate.

acg_component

Adaptive Cache Governor (ACG) request and execution intercept helpers for the adaptive runtime.

acg_learner

Adaptive Cache Governor (ACG) learner for the adaptive telemetry pipeline.

acg_profile

Derives stable Adaptive Cache Governor (ACG) profile keys from structured LLM requests.

adaptive_hints_intercept

AdaptiveHintsIntercept: opt-in LLM request intercept that injects AgentHints from HotCache trie.

cache_diagnostics

Runtime-local cache miss request facts and diagnostics tracking.

config

Canonical adaptive config and diagnostics types.

context_helpers

Context helpers for reading scope metadata on the intercept hot path.

drain

Background drain task for async telemetry processing.

error

Error types for the nemo-flow-adaptive crate.

intercepts

Intercept factories for the nemo-flow-adaptive crate, including Adaptive Cache Governor (ACG) intercepts.

learner

Learning primitives and built-in learner implementations. Adaptive learners that derive runtime hints from observed executions.

plugin_component

Core plugin integration for the adaptive runtime.

storage

Storage backends and backend traits for adaptive state persistence. Storage backends for adaptive runtime state and learned artifacts.

subscriber

Event subscriber factory and event-to-record mapping helpers.

tool_parallelism_learner

Learner that derives tool fan-out plans from observed runs. Learner that derives tool parallelism plans from observed runs.

trie

Prediction trie data structures for the online learning engine.

types

Serializable adaptive data models shared across runtime components. Serializable adaptive runtime data models.

Structs

AdaptiveRuntime

Hosted adaptive runtime that registers NeMo Flow plugin components.