Expand description
Prelude module for convenient imports.
Re-exports§
pub use crate::RingKernel;
Modules§
- align
- Alignment utilities.
- message_
flags - Flags for extended H2K messages.
- priority
- Priority constants for convenient use.
Structs§
- Alert
- An alert to be routed to sinks.
- Alert
Router - Alert router that sends alerts to multiple sinks.
- Alert
Router Stats - Alert router statistics.
- Allocation
Handle - Handle to an allocation within an AnalyticsContext.
- Analytics
Context - Context for analytics operations with grouped buffer lifecycle.
- Analytics
Context Builder - Builder for AnalyticsContext with pre-configuration.
- ApiKey
Auth - API key authentication provider.
- AppInfo
- Application information.
- Audit
Config - Configuration for the audit logger.
- Audit
Event - A structured audit event.
- Audit
Logger - The main audit logger.
- Audit
Logger Builder - Builder for AuditLogger.
- Auth
Context - Authentication context for an authenticated request.
- Background
Task Status - Status of background tasks.
- BlockId
- Block ID within a grid (0 to grid_size - 1).
- Bounded
Queue - Bounded queue with blocking operations.
- Cached
Secret Store - A wrapper that adds caching to any secret store.
- Cancellation
Token - A token that can be used to cancel an operation.
- Chained
Auth Provider - Authentication provider that tries multiple providers in order.
- Chained
Secret Store - A secret store that chains multiple stores, trying each in order.
- Circuit
Breaker - Circuit breaker for fault isolation.
- Circuit
Breaker Config - Circuit breaker configuration.
- Circuit
Breaker Stats - Circuit breaker statistics.
- Circuit
Guard - Guard for executing operations with circuit breaker protection.
- Cloud
Storage Config - Cloud storage configuration for checkpoint persistence.
- Cloud
Watch Config - Configuration for CloudWatch Logs sink.
- Cloud
Watch Sink - CloudWatch Logs sink for AWS-native audit logging.
- Compliance
Check - A single compliance check.
- Compliance
Report - A complete compliance report.
- Compliance
Reporter - Compliance reporter for generating compliance documentation.
- Compliance
Summary - Summary statistics for a compliance report.
- Config
Builder - Fluent builder for RingKernelConfig.
- Console
Sink - Console log sink.
- Context
Metrics - Context metrics for monitoring the unified runtime.
- Context
Metrics Buffer - Buffer for collecting metrics within a kernel context.
- Context
Stats - Statistics for an analytics context.
- Control
Block - Kernel control block (128 bytes, cache-line aligned).
- Control
Block State Helper - Helper for reading/writing state to/from ControlBlock.
- Correlation
Id - Correlation ID for request-response patterns.
- Cross
GpuK2K Router - Routes K2K messages across GPU boundaries.
- Cross
GpuRouter Stats Snapshot - Snapshot of router statistics.
- Deadline
- A deadline for an operation.
- Deduplication
Config - Configuration for alert deduplication.
- Degradation
Guard - Guard for graceful degradation.
- Degradation
Manager - Graceful degradation manager.
- Degradation
Stats - Degradation statistics.
- Device
Info - Information about a GPU device.
- Device
Status - Status of a device in the multi-GPU coordinator.
- Device
Unregister Result - Result of unregistering a device from the coordinator.
- Dim3
- 3D dimension specification.
- Dispatch
Table - Dispatch table mapping handler IDs to functions.
- Dispatcher
Builder - Builder for creating a KernelDispatcher.
- Dispatcher
Config - Configuration for the kernel dispatcher.
- Dispatcher
Metrics - Metrics for dispatcher operations.
- Domain
Parse Error - Error returned when parsing an invalid domain string.
- Encrypted
Region - An encrypted memory region.
- Encryption
Config - Configuration for memory encryption.
- Encryption
Key - Represents an encryption key with metadata.
- Encryption
Stats - Statistics for memory encryption operations.
- EnvVar
Secret Store - Secret store backed by environment variables.
- File
LogSink - File log sink.
- File
Sink - File-based audit sink.
- General
Config - General runtime settings.
- General
Config Builder - Builder for GeneralConfig.
- Global
Thread Id - Global thread ID across all blocks.
- GpuConnection
- Connection between two GPUs.
- GpuDevice
Memory Stats - Per-device GPU memory statistics.
- GpuMemory
Allocation - A tracked GPU memory allocation.
- GpuMemory
Dashboard - GPU Memory Dashboard for monitoring and visualization.
- GpuMemory
Pool Stats - GPU memory pool statistics.
- GpuMemory
Thresholds - Memory pressure thresholds for alerts.
- GpuTopology
- GPU topology graph describing all device interconnections.
- Grafana
Dashboard - Grafana dashboard builder.
- Grafana
Panel - A Grafana panel definition.
- Handler
Registration - Handler registration entry for the dispatch table.
- Health
Check - A health check definition.
- Health
Check Result - Result of a health check.
- Health
Checker - Health checker that manages multiple health checks.
- Health
Config - Health monitoring settings.
- Health
Config Builder - Builder for HealthConfig.
- Health
Cycle Result - Result of a health check cycle run by the runtime context.
- HlcClock
- Hybrid Logical Clock for generating causally-ordered timestamps.
- HlcState
- Compact HLC state for GPU-side storage (16 bytes).
- HlcTimestamp
- Hybrid Logical Clock timestamp.
- HotReload
Config - Configuration for kernel hot reload operations.
- HotReload
Manager - Manager for kernel hot reload operations.
- HotReload
Request - Request to hot reload a kernel.
- HotReload
Result - Result of a completed hot reload.
- HotReload
Stats Snapshot - Snapshot of hot reload statistics.
- Identity
- Identity of an authenticated principal.
- InMemory
Secret Store - In-memory secret store for testing.
- InMemory
Sink - Alert sink that stores alerts in memory (for testing).
- K2KBroker
- K2K message broker for routing messages between kernels.
- K2KBuilder
- Builder for creating K2K infrastructure.
- K2KConfig
- Configuration for K2K messaging.
- K2KEndpoint
- K2K endpoint for a single kernel.
- K2KMessage
- A K2K message with routing information.
- K2KMessage
Registration - Registration information for a K2K-routable message type.
- K2KType
Registry - Registry for discovering K2K-routable message types at runtime.
- Kernel
Alert - An alert emitted from a kernel.
- Kernel
Code Source - Kernel code source for hot reload.
- Kernel
Dispatcher - Routes messages by type_id to registered handler kernels.
- Kernel
Handle - Handle to a launched kernel.
- Kernel
Health - Kernel health status for watchdog.
- Kernel
Id - Unique kernel identifier.
- Kernel
Metrics - Extended metrics for detailed monitoring.
- Kernel
Migration Plan - Plan for migrating a single kernel during device unregister.
- Kernel
Migrator - Migrator that uses checkpoints for kernel state transfer between GPUs.
- Kernel
Sandbox - Kernel sandbox for isolation and resource control.
- Kernel
Status - Kernel status including state and metrics.
- Kernel
Watchdog - Watchdog for monitoring kernel health.
- KeyRotation
Manager - Manages automatic key rotation for encryption keys.
- Latency
Histogram - Histogram for latency distribution.
- Launch
Options - Options for launching a kernel.
- Load
Shedding Policy - Load shedding policy.
- LogEntry
- A structured log entry.
- LogSink
- Alert sink that writes to the tracing/log system.
- Logger
Stats - Logger statistics.
- Memory
Encryption - Memory encryption manager for GPU memory protection.
- Memory
LogSink - Memory log sink for testing.
- Memory
Pool - Memory pool for efficient allocation/deallocation.
- Memory
Sink - In-memory audit sink for testing.
- Message
Envelope - Envelope containing header and serialized payload.
- Message
Header - Fixed-size message header (256 bytes, cache-line aligned).
- Message
Id - Unique message identifier.
- Metrics
Collector - Metrics collector that aggregates metrics from multiple kernels.
- Metrics
Entry - A single metrics entry recorded by the kernel.
- Metrics
Snapshot - A snapshot of metrics at a point in time.
- Migration
Config - Kernel migration settings.
- Migration
Config Builder - Builder for MigrationConfig.
- Migration
Request - Request to migrate a kernel between devices.
- Migration
Result - Result of a completed migration.
- Migration
Stats Snapshot - Snapshot of migration statistics.
- Monitoring
Config - Configuration for background monitoring loops.
- Monitoring
Handles - Handles for background monitoring tasks.
- Mpsc
Queue - Multi-producer single-consumer lock-free queue.
- Multi
GpuBuilder - Builder for multi-GPU coordinator.
- Multi
GpuConfig - Multi-GPU coordination settings.
- Multi
GpuConfig Builder - Builder for MultiGpuConfig.
- Multi
GpuCoordinator - Multi-GPU coordinator for managing kernels across devices.
- Observability
Config - Observability settings.
- Observability
Config Builder - Builder for ObservabilityConfig.
- Observability
Context - Global observability context for managing spans and metrics.
- Operation
Context - Context for tracking operation state including deadlines and cancellation.
- Otlp
Config - Configuration for OTLP exporter.
- Otlp
Export Result - OTLP export result.
- Otlp
Exporter - OTLP span exporter for sending traces to OTLP-compatible backends.
- Otlp
Exporter Stats - Statistics for the OTLP exporter.
- Pending
K2KMessage - A pending cross-GPU K2K message.
- Pinned
Memory - Pinned (page-locked) host memory for efficient DMA transfers.
- Policy
Evaluator - RBAC policy evaluator.
- Pooled
Buffer - A buffer from a memory pool.
- Pressure
Handler - Memory pressure handler for stratified pools.
- Prometheus
Exporter - Prometheus metrics exporter.
- PubSub
Broker - Pub/sub message broker.
- PubSub
Builder - Builder for creating pub/sub infrastructure.
- Publication
- A published message on a topic.
- Queue
Factory - Factory for creating appropriately-sized message queues.
- Queue
Metrics - Comprehensive queue metrics snapshot.
- Queue
Monitor - Monitor for queue health and utilization.
- Queue
Stats - Statistics for a message queue.
- Quota
Utilization - Quota utilization percentages.
- Rate
Limit Config - Configuration for rate limiting.
- Rate
Limit Guard - RAII guard for rate-limited operations.
- Rate
Limiter - Global rate limiter.
- Rate
Limiter Builder - Builder for creating rate limiters.
- Rate
Limiter Stats Snapshot - Snapshot of rate limiter statistics.
- Rbac
Policy - RBAC policy definition.
- Recovery
Action - A recovery action to be taken.
- Recovery
Config - Configuration for automatic recovery.
- Recovery
Config Builder - Builder for recovery configuration.
- Recovery
Manager - Manager for automatic kernel recovery.
- Recovery
Result - Result of a recovery action.
- Recovery
Stats Snapshot - Snapshot of recovery statistics.
- Reduction
Config - Configuration for reduction operations.
- Resource
Limits - Resource limits for sandboxed kernels.
- Resource
Quota - Resource quotas for a tenant.
- Resource
Rule - A rule for specific resources.
- Resource
Usage - Current resource usage for a tenant.
- Retry
Config - Retry configuration.
- Retry
Policy - Retry policy configuration.
- Ring
Context - GPU intrinsics facade for kernel handlers.
- Ring
Kernel Collector - Prometheus collector for RingKernel metrics.
- Ring
Kernel Config - Unified configuration for RingKernel.
- Ring
Kernel Context - Unified runtime context managing all enterprise features.
- Role
- A role with a set of permissions.
- Runtime
Builder - Builder for RingKernelContext.
- Runtime
Metrics - Runtime-level metrics.
- Runtime
Stats Snapshot - Snapshot of runtime statistics.
- Sandbox
Policy - Sandbox policy defining what a kernel can access.
- Sandbox
Stats - Statistics for sandbox enforcement.
- Sandbox
Violation - A recorded sandbox violation.
- Secret
Key - A key identifying a secret in the store.
- Secret
Value - A secret value retrieved from the store.
- Shutdown
Report - Report generated after shutdown completes.
- Span
- An OpenTelemetry-compatible span.
- Span
Builder - Builder for creating spans with fluent API.
- Span
Event - An event that occurred during a span.
- SpanId
- A span ID compatible with OpenTelemetry W3C Trace Context.
- Spsc
Queue - Single-producer single-consumer lock-free ring buffer.
- State
Descriptor - Descriptor stored in
_reservedwhen using external state. - State
Snapshot - Snapshot of kernel state for checkpointing.
- Stratified
Buffer - A buffer from a stratified memory pool.
- Stratified
Memory Pool - Multi-size memory pool with automatic bucket selection.
- Stratified
Pool Stats - Statistics for a stratified memory pool.
- Structured
LogConfig - Configuration for structured logging.
- Structured
LogConfig Builder - Builder for log configuration.
- Structured
LogSink Error - Log sink error.
- Structured
Logger - Structured logger with trace correlation.
- Subject
- Subject for RBAC evaluation (who is making the request).
- Subscription
- A subscription to a topic.
- Syslog
Config - Configuration for syslog sink.
- Syslog
Sink - RFC 5424 syslog sink for remote audit log forwarding.
- Telemetry
Alert - An alert when telemetry thresholds are exceeded.
- Telemetry
Buffer - Telemetry buffer (64 bytes, cache-line aligned).
- Telemetry
Config - Configuration for the telemetry pipeline.
- Telemetry
Pipeline - Real-time telemetry pipeline.
- Tenant
Context - Context for tenant-scoped operations.
- Tenant
Registry - Registry for managing tenants.
- Thread
Id - Thread ID within a block (0 to block_size - 1).
- Timeout
- Future that wraps another future with a timeout.
- Timeout
Error - Error returned when an operation times out.
- Timeout
Stats - Statistics for timeout tracking.
- Timeout
Stats Snapshot - Snapshot of timeout statistics.
- Topic
- A topic name for pub/sub messaging.
- Trace
Context - Thread-local trace context for correlation.
- TraceId
- A trace ID compatible with OpenTelemetry W3C Trace Context.
- WarpId
- Warp ID within a block.
- Watchdog
Result - Result of a watchdog scan cycle.
Enums§
- Access
Level - Access control for kernel operations.
- Alert
Routing - Routing destination for alerts.
- Alert
Severity - Alert severity levels.
- Alert
Sink Error - Error type for alert sink operations.
- Audit
Event Type - Types of audit events.
- Audit
Level - Audit event severity levels.
- Auth
Error - Error type for authentication operations.
- Backend
- GPU backend type.
- Backoff
Strategy - Backoff strategy for retries.
- Checkpoint
Storage Type - Checkpoint storage type.
- Circuit
State - Circuit breaker state.
- Compliance
Standard - Compliance standard for reporting.
- Compliance
Status - Compliance check result.
- Context
Backend - Backend-specific context implementation.
- Control
Error - Error codes for control block.
- Credentials
- Credentials provided by a client for authentication.
- Degradation
Level - Degradation level for system operation.
- Delivery
Status - Status of message delivery.
- Domain
- Business domain classification for kernel messages.
- Encryption
Algorithm - Encryption algorithm for GPU memory protection.
- Environment
- Runtime environment.
- Failure
Type - Types of kernel failures.
- Fence
Scope - Memory fence scope for synchronization operations.
- GpuMemory
Type - GPU memory allocation type.
- Health
Status - Health status of a component.
- HotReload
State - State of a hot reload operation.
- Interconnect
Type - Type of interconnect between GPUs.
- Kernel
Alert Type - Type of kernel alert.
- Kernel
Code Format - Kernel code format.
- Kernel
Mode - Kernel execution mode.
- Kernel
State - Kernel lifecycle state.
- KeyDerivation
- Key derivation function for encryption keys.
- Lifecycle
State - State of the runtime lifecycle.
- Load
Balancing Strategy - Strategy for balancing load across devices.
- LogLevel
- Log level configuration.
- LogOutput
- Log output format.
- LogValue
- Log field value types.
- Memory
Order - Memory ordering for atomic operations.
- Memory
Pressure Level - Memory pressure level.
- Metric
Type - Type of metric entry.
- Migration
Priority - Priority for kernel migration.
- Migration
State - State of a kernel migration.
- Operation
Priority - Operation priority for load shedding decisions.
- Otlp
Transport - OTLP transport protocol.
- Panel
Type - Grafana panel type.
- Permission
- Fine-grained permissions for kernel operations.
- Pressure
Reaction - Reaction to memory pressure events.
- Priority
- Message priority levels.
- QoS
- Quality of Service level for message delivery.
- Queue
Health - Queue health status from monitoring.
- Queue
Tier - Queue capacity tiers for dynamic queue allocation.
- Rate
Limit Algorithm - Rate limiting algorithm to use.
- Rate
Limit Error - Errors that can occur during rate limiting.
- Rbac
Error - Error type for RBAC evaluation.
- Recovery
Policy - Recovery policy for handling kernel failures.
- Reduction
Op - Reduction operation types.
- Report
Format - Report output format.
- Ring
Kernel Error - Comprehensive error type for RingKernel operations.
- Routing
Decision - Decision for how to route a K2K message.
- Secret
Error - Error type for secret store operations.
- Size
Bucket - Size bucket for stratified pooling.
- Span
Kind - Span kind (OpenTelemetry compatible).
- Span
Status - Span status (OpenTelemetry compatible).
- Structured
LogLevel - Log severity levels.
- Syslog
Facility - Syslog facility codes (RFC 5424).
- Syslog
Severity - Syslog severity codes (RFC 5424).
- Telemetry
Event - A telemetry event that is broadcast to subscribers.
- Tenant
Error - Error type for tenant operations.
- Violation
Type - Sandbox violation type.
Constants§
- CONTROL_
BLOCK_ STATE_ SIZE - Size of the reserved field in ControlBlock available for state storage.
- MAX_
CLOCK_ SKEW_ MS - Maximum allowed clock skew in milliseconds.
- MAX_
INLINE_ PAYLOAD_ SIZE - Maximum size for inline payload in extended messages. Messages larger than this must use external buffer references.
- STATE_
DESCRIPTOR_ MAGIC - Magic number for state descriptor (“STAT” in little-endian).
Traits§
- Alert
Sink - Trait for pluggable alert destinations.
- Audit
Sink - Trait for audit log output sinks.
- Auth
Provider - Trait for pluggable authentication providers.
- Device
Memory - Trait for device memory allocation.
- Domain
Message - Trait for messages that belong to a specific business domain.
- Embedded
State - Trait for state types that can be embedded directly in ControlBlock.
- Embedded
State Size - Marker trait to verify state fits in 24 bytes at compile time.
- Global
Reduction - Trait for GPU runtimes that support global reduction operations.
- GpuBuffer
- Trait for GPU buffer operations.
- GpuState
- Trait for GPU-compatible state types that may be stored externally.
- HotReloadable
Kernel - Trait for kernels that support hot reload.
- Kernel
Handle Inner - Inner trait for kernel handle implementation.
- Message
Queue - Trait for message queue implementations.
- Migratable
Kernel - Trait for kernels that support live migration.
- Persistent
Message - Trait for messages that can be dispatched within a persistent GPU kernel.
- Pressure
Aware Pool - Extension trait for pressure-aware memory pools.
- Prometheus
Collector - Trait for collecting Prometheus metrics.
- Rate
Limiter Ext - Extension trait for acquiring guards.
- Reduction
Handle - Handle to a reduction buffer for streaming operations.
- Reduction
Scalar - Trait for scalar types that support reduction operations.
- Ring
Kernel Runtime - Backend-agnostic runtime trait for kernel management.
- Ring
Message - Trait for types that can be sent as kernel messages.
- Secret
Store - Trait for pluggable secret storage backends.
- Structured
LogSink - Trait for log output destinations.
Functions§
- create_
pool - Create a shared memory pool.
- create_
stratified_ pool - Create a shared stratified memory pool.
- create_
stratified_ pool_ with_ capacity - Create a shared stratified memory pool with custom capacity.
- shared_
rate_ limiter - Create a shared rate limiter.
- timeout
- Wrap a future with a timeout.
- timeout_
named - Wrap a future with a timeout and operation name.
- with_
timeout - Execute an async operation with timeout using tokio.
- with_
timeout_ named - Execute an async operation with timeout and operation name.
Type Aliases§
- Alert
Sink Result - Result type for alert sink operations.
- Auth
Result - Result type for authentication operations.
- BoxFuture
- Type-erased future for async operations.
- Pressure
Callback - Callback type for memory pressure changes.
- Rate
Limit Result - Result type for rate limiting operations.
- Rbac
Result - Result type for RBAC evaluation.
- Result
- Result type alias for RingKernel operations.
- Secret
Result - Result type for secret store operations.
- Shared
Memory Pool - Shared memory pool that can be cloned.
- Shared
Rate Limiter - Thread-safe, shareable rate limiter.
- Shared
Stratified Pool - Shared stratified memory pool.
- Tenant
Result - Result type for tenant operations.
Attribute Macros§
- gpu_
kernel - Attribute macro for defining multi-backend GPU kernels.
- ring_
kernel - Attribute macro for defining ring kernel handlers.
- stencil_
kernel - Attribute macro for defining stencil kernels that transpile to CUDA.
Derive Macros§
- Control
Block State - Derive macro for implementing EmbeddedState trait.
- GpuType
- Derive macro for GPU-compatible types.
- Persistent
Message - Derive macro for implementing the PersistentMessage trait.
- Ring
Message - Derive macro for implementing the RingMessage trait.