Expand description
Shared state management for thread-based architecture
This module provides the core shared memory infrastructure that enables efficient communication between worker threads while maintaining thread safety.
Re-exports§
Structs§
- Atomic
Counters - Atomic counters for system metrics
- Conversation
Hierarchy - Hierarchical conversation storage for reduced lock contention
- LLMRuntime
- Direct LLM runtime integration
- Pending
Message - Pending message for asynchronous processing
- PreExtracted
- Cached result of pre-extracting a file attachment before the user hits Send.
Populated by
POST /attachments/preprocess, consumed by/generate/stream. - Session
Data - Session-level data structure
- Shared
System State - Core shared system state container
- Unified
AppState - Unified application state for all API handlers. This is the single state type used by the Axum router, providing access to all subsystems through shared memory (Arc) rather than network hops.