Expand description
Agentic / LLM GPU actor blueprints on atomr-accel-cuda.
ⓘ
use atomr_accel_agents::prelude::*;shared_state::SharedGpuStateCoordinator— write-token coordination over aManagedRef<f32>world buffer.embedding_cache::EmbeddingCache— LRU cache of(input hash) -> Vec<f32>.rag::RagPipeline— retrieval + generate harness.vector_index::CpuVectorIndex— top-k cosine similarity over a flat host index.langgraph_nodes::LangGraphGpuActor— DAG executor with cycle detection.
Modules§
- embedding_
cache EmbeddingCache— LRU cache of(input hash) -> Vec<f32>.- langgraph_
nodes LangGraphGpuNodes— composable agent graph nodes.- prelude
- Canonical re-exports.
use atomr_accel_agents::prelude::*;. - rag
RagPipeline— query → embedding → vector search → context assembly → LLM call.- shared_
state SharedGpuStateCoordinator— issues write tokens to N agents sharing aManagedRef<f32>world-state buffer.- vector_
index GpuVectorIndex— similarity-search index abstraction.