List of all items

Structs

• GpuStream
• megakernel::advanced::hierarchical_atomics::HitRingBindings
• megakernel::advanced::parallel_dfa::ParallelDfaBindings
• megakernel::advanced::zero_copy_io::DirectIoBindings
• megakernel::descriptor::BatchDescriptor
• megakernel::descriptor::PackedOpDescriptor
• megakernel::descriptor::WindowDescriptor
• megakernel::execution::Megakernel
• megakernel::execution::MegakernelBatchDispatchOutput
• megakernel::execution::MegakernelDispatchOutput
• megakernel::execution::MegakernelDispatchStats
• megakernel::execution::MegakernelResidentBatchScratch
• megakernel::execution::MegakernelResidentHandles
• megakernel::handlers::OpcodeHandler
• megakernel::io::IoCompletion
• megakernel::io::IoRequest
• megakernel::io::MegakernelIoQueue
• megakernel::planner::BarrierElisionReport
• megakernel::planner::CompactFusionPlanningScratch
• megakernel::planner::CrossArmRedundancy
• megakernel::planner::CrossPipelineFusionPlan
• megakernel::planner::FusionSelectionScratch
• megakernel::planner::MegakernelCaps
• megakernel::planner::MegakernelConfig
• megakernel::planner::MegakernelGridLimits
• megakernel::planner::MegakernelGridPlan
• megakernel::planner::MegakernelGridRequest
• megakernel::planner::MegakernelLaunchGeometry
• megakernel::planner::MegakernelReport
• megakernel::planner::MegakernelSizingPolicy
• megakernel::planner::MegakernelTelemetry
• megakernel::planner::MegakernelWorkItem
• megakernel::planner::MegakernelWorkloadHints
• megakernel::planner::PipelineFusionBreak
• megakernel::planner::PipelineFusionSegment
• megakernel::planner::RedundantWorkItemPruneScratch
• megakernel::policy::MegakernelLaunchCacheStats
• megakernel::policy::MegakernelLaunchPolicy
• megakernel::policy::MegakernelLaunchRecommendation
• megakernel::policy::MegakernelLaunchRequest
• megakernel::policy::PriorityRequeueAccounting
• megakernel::protocol::DebugRecord
• megakernel::readback::MegakernelReadback
• megakernel::readback::MegakernelReadbackCounters
• megakernel::recovery::MegakernelRecoveryPolicy
• megakernel::resident::MegakernelResidentBuffers
• megakernel::resident::MegakernelResidentDispatchScratch
• megakernel::ring::HostRing
• megakernel::rule_catalog::BatchRuleProgram
• megakernel::rule_catalog::BatchRuleRejection
• megakernel::rule_catalog::PackedRuleCatalog
• megakernel::rule_catalog::RuleCatalogPackingScratch
• megakernel::rule_catalog::RuleMeta
• megakernel::speculation::PairedSpeculationSample
• megakernel::speculation::PairedSpeculationUpdate
• megakernel::speculation::PairedSpeculationWindow
• megakernel::task::TaskQueueSnapshot
• megakernel::task::TaskWorkItem
• megakernel::telemetry::ControlSnapshot
• megakernel::telemetry::CountMinSketch
• megakernel::telemetry::MegakernelRuntimeCounters
• megakernel::telemetry::MegakernelWatchdogSnapshot
• megakernel::telemetry::RingOccupancy
• megakernel::telemetry::RingSlotSnapshot
• megakernel::telemetry::RingTelemetry
• megakernel::telemetry::SketchTelemetry
• megakernel::telemetry::SketchTelemetryScratch
• megakernel::telemetry::TelemetryDecodeScratch
• megakernel::telemetry::WindowTelemetry
• megakernel::workspace_layout::MegakernelWorkspaceRegion
• pipeline_cache::DiskCache
• pipeline_cache::InMemoryPipelineCache
• pipeline_cache::LayeredPipelineCache
• pipeline_cache::PipelineCacheMetrics
• pipeline_cache::PipelineFingerprint
• pipeline_cache::RemoteCache
• replay::RecordedSlot
• replay::RingLog
• routing::RoutingEngine
• routing::standard_policy::StandardPolicy
• scheduler::Shard
• scheduler::WorkStealingScheduler
• tenant::TenantHandle
• tenant::TenantRegistry
• tenant::TenantRuntimeCounters
• tenant::TenantSelectionScratch
• uring::driver::CompletedIngest
• uring::driver::NvmeGpuIngestDriver
• uring::driver::NvmeGpuIngestTelemetry
• uring::io_loop::MegakernelIoLoop
• uring::io_loop::RegisteredIoDestination
• uring::pump::UringMegakernelPump
• uring::ring::IoUringState
• uring::ring::io_cqring_offsets
• uring::ring::io_sqring_offsets
• uring::ring::io_uring_cqe
• uring::ring::io_uring_params
• uring::ring::io_uring_sqe
• uring::stream::AsyncUringStream
• uring::stream::GpuMappedBuffer
• uring::stream::Iovec

Enums

• PipelineError
• megakernel::descriptor::BuiltinOpcode
• megakernel::descriptor::SlotDescriptor
• megakernel::descriptor::SlotOpcode
• megakernel::descriptor::WindowClass
• megakernel::planner::FusionSelectionError
• megakernel::policy::MegakernelDispatchTopology
• megakernel::policy::MegakernelExecutionMode
• megakernel::policy::MegakernelQueuePressure
• megakernel::protocol::ProtocolError
• megakernel::recovery::MegakernelRecoveryDecision
• megakernel::task::TaskPriority
• megakernel::task::TaskState
• megakernel::telemetry::RingStatus
• megakernel::workspace_layout::MegakernelWorkspaceLayoutError
• megakernel::workspace_layout::MegakernelWorkspaceRegionSpec
• pipeline_cache::DiskCacheError
• replay::ReplayLogError
• routing::RoutingDecision
• tenant::TenantError
• uring::driver::NativeReadPath
• uring::gpudirect::GpuDirectCapability

Traits

• megakernel::MegakernelDispatch
• megakernel::ring::RingConsumer
• megakernel::ring::RingProducer
• megakernel::workspace_adapter::MegakernelWorkspaceAdapter
• pipeline_cache::PipelineCacheStore
• routing::RoutingPolicy

Functions

• megakernel::advanced::hierarchical_atomics::record_hit_to_ring_hierarchical
• megakernel::advanced::hierarchical_atomics::record_hit_to_ring_hierarchical_with
• megakernel::advanced::parallel_dfa::dfa_byte_scanner_parallel_composition
• megakernel::advanced::parallel_dfa::dfa_byte_scanner_parallel_composition_with
• megakernel::advanced::zero_copy_io::pull_file_async_direct
• megakernel::advanced::zero_copy_io::pull_file_async_direct_with
• megakernel::builder::build_program
• megakernel::builder::build_program_jit
• megakernel::builder::build_program_jit_slots
• megakernel::builder::build_program_priority
• megakernel::builder::build_program_priority_slots
• megakernel::builder::build_program_sharded
• megakernel::builder::build_program_sharded_no_io
• megakernel::builder::build_program_sharded_once_slots
• megakernel::builder::build_program_sharded_once_slots_control_report_shared
• megakernel::builder::build_program_sharded_once_slots_shared
• megakernel::builder::build_program_sharded_slots
• megakernel::builder::build_program_sharded_slots_shared
• megakernel::builder::build_program_sharded_with_io_polling
• megakernel::builder::build_program_sharded_with_workspace_adapter
• megakernel::builder::build_program_with_self_loading_miss_handler
• megakernel::builder::persistent_body
• megakernel::builder::persistent_body_jit
• megakernel::builder::persistent_body_priority
• megakernel::builder::persistent_body_priority_slots
• megakernel::builder::try_build_program_with_self_loading_miss_handler
• megakernel::builder::try_persistent_body
• megakernel::io::claim_io_requests_into
• megakernel::io::complete_io_request
• megakernel::io::complete_io_requests_batch
• megakernel::io::encode_empty_io_queue
• megakernel::io::io_completion_poll_body
• megakernel::io::poll_io_requests
• megakernel::io::try_claim_io_requests_into
• megakernel::io::try_complete_io_request
• megakernel::io::try_complete_io_requests_batch
• megakernel::io::try_encode_empty_io_queue
• megakernel::io::try_encode_empty_io_queue_into
• megakernel::io::try_poll_io_requests
• megakernel::io::try_poll_io_requests_into
• megakernel::io::validate_io_queue_bytes
• megakernel::ir_util::atomic_load_relaxed
• megakernel::ir_util::atomic_store_relaxed
• megakernel::planner::build_bellman_tn_order_program
• megakernel::planner::build_kfac_autotune_step_program
• megakernel::planner::build_persistent_fixpoint_program
• megakernel::planner::build_scallop_lineage_with_program_and_scratch
• megakernel::planner::build_scallop_lineage_with_scratch
• megakernel::planner::build_scallop_provenance_wide_program
• megakernel::planner::build_sinkhorn_clustering_program
• megakernel::planner::build_sinkhorn_full_clustering_program
• megakernel::planner::default_worker_groups_from_limits
• megakernel::planner::detect_cross_arm_redundancy
• megakernel::planner::dispatch_grid_for
• megakernel::planner::elide_value_flow_barriers
• megakernel::planner::padded_slot_count
• megakernel::planner::plan_compact_fusion_into
• megakernel::planner::plan_cross_pipeline_fusion
• megakernel::planner::prune_dead_arms_inplace
• megakernel::planner::prune_redundant_work_items_into
• megakernel::planner::prune_redundant_work_items_with_scratch_into
• megakernel::planner::select_fused_subset
• megakernel::planner::select_fused_subset_checked_into
• megakernel::planner::select_fused_subset_compact
• megakernel::planner::select_fused_subset_compact_checked_into
• megakernel::planner::select_fused_subset_compact_into
• megakernel::planner::select_fused_subset_into
• megakernel::planner::select_fused_subset_pruned
• megakernel::planner::select_fused_subset_pruned_into
• megakernel::planner::select_fused_subset_with_rate
• megakernel::planner::select_optimal_fused_subset
• megakernel::planner::shared_prologue_length
• megakernel::planner::try_detect_cross_arm_redundancy
• megakernel::planner::try_elide_value_flow_barriers
• megakernel::planner::try_prune_redundant_work_items_into
• megakernel::planner::try_prune_redundant_work_items_with_scratch_into
• megakernel::planner::worker_workgroup_size
• megakernel::policy::diffuse_priority_across_siblings
• megakernel::policy::diffuse_priority_across_siblings_into
• megakernel::policy::try_diffuse_priority_across_siblings
• megakernel::policy::try_diffuse_priority_across_siblings_into
• megakernel::protocol::control_byte_len
• megakernel::protocol::count_done_ring_slots
• megakernel::protocol::debug_log_byte_len
• megakernel::protocol::decode_expert_miss
• megakernel::protocol::decode_load_miss
• megakernel::protocol::encode_control
• megakernel::protocol::encode_empty_debug_log
• megakernel::protocol::encode_empty_ring
• megakernel::protocol::encode_expert_miss
• megakernel::protocol::encode_load_miss
• megakernel::protocol::opcode::is_builtin
• megakernel::protocol::opcode::is_system
• megakernel::protocol::opcode::validate_publish_opcode
• megakernel::protocol::opcode::validate_user_opcode
• megakernel::protocol::read_debug_log
• megakernel::protocol::read_debug_log_into
• megakernel::protocol::read_done_count
• megakernel::protocol::read_epoch
• megakernel::protocol::read_metrics
• megakernel::protocol::read_metrics_into
• megakernel::protocol::read_observable
• megakernel::protocol::ring_byte_len
• megakernel::protocol::try_count_done_ring_slots
• megakernel::protocol::try_encode_control
• megakernel::protocol::try_encode_control_into
• megakernel::protocol::try_encode_empty_debug_log
• megakernel::protocol::try_encode_empty_debug_log_into
• megakernel::protocol::try_encode_empty_ring
• megakernel::protocol::try_encode_empty_ring_into
• megakernel::protocol::try_read_debug_log
• megakernel::protocol::try_read_debug_log_into
• megakernel::protocol::try_read_done_count
• megakernel::protocol::try_read_epoch
• megakernel::protocol::try_read_metrics
• megakernel::protocol::try_read_metrics_into
• megakernel::protocol::try_read_observable
• megakernel::recovery::backend_error_indicates_device_loss
• megakernel::recovery::recover_compiled_pipeline
• megakernel::rule_catalog::accepted_rule_fingerprints
• megakernel::rule_catalog::accepted_rule_fingerprints_and_rejections_into
• megakernel::rule_catalog::accepted_rule_fingerprints_into
• megakernel::rule_catalog::pack_rule_catalog
• megakernel::rule_catalog::pack_rule_catalog_into
• megakernel::scheduler::check_priority_fairness
• megakernel::scheduler::check_tenant_fairness
• megakernel::scheduler::default_priority_offsets
• megakernel::scheduler::default_priority_offsets_array
• megakernel::scheduler::policy_offset_start
• megakernel::scheduler::priority_partition_active_lane_count
• megakernel::scheduler::priority_partition_probe_budget
• megakernel::scheduler::priority_partition_probe_count
• megakernel::scheduler::priority_scan_body
• megakernel::scheduler::priority_scan_body_with_stride
• megakernel::scheduler::try_default_priority_offsets
• megakernel::scheduler::write_default_priority_offsets
• megakernel::workspace_layout::build_workspace_regions
• megakernel::workspace_layout::first_workspace_region
• megakernel::workspace_layout::next_record_workspace_region
• megakernel::workspace_layout::next_workspace_region
• megakernel::workspace_layout::workspace_record_words
• uring::gpudirect::encode_nvme_read_sqe

Type Aliases

• pipeline_cache::PersistentPipelineCacheStore

Constants

• megakernel::io::IO_DESTINATION_CAPABILITY_TABLE
• megakernel::io::IO_QUEUE_DMA_TAG
• megakernel::io::IO_SLOT_COUNT
• megakernel::io::IO_SLOT_WORDS
• megakernel::io::IO_SOURCE_CAPABILITY_TABLE
• megakernel::io::io_op::FENCE
• megakernel::io::io_op::READ
• megakernel::io::io_op::WRITE
• megakernel::io::io_status::ERROR
• megakernel::io::io_status::OK
• megakernel::io::io_word::BYTE_COUNT
• megakernel::io::io_word::DST_HANDLE
• megakernel::io::io_word::OFFSET_HI
• megakernel::io::io_word::OFFSET_LO
• megakernel::io::io_word::OP_TYPE
• megakernel::io::io_word::SRC_HANDLE
• megakernel::io::io_word::STATUS
• megakernel::io::io_word::TAG
• megakernel::protocol::ARG0_WORD
• megakernel::protocol::ARGS_PER_SLOT
• megakernel::protocol::CONTROL_MIN_WORDS
• megakernel::protocol::MAX_DEBUG_RECORDS
• megakernel::protocol::MAX_ENCODED_DEBUG_RECORDS
• megakernel::protocol::MAX_ENCODED_OBSERVABLE_SLOTS
• megakernel::protocol::MAX_ENCODED_RING_SLOTS
• megakernel::protocol::MAX_OBSERVABLE_SLOTS
• megakernel::protocol::MAX_RING_SLOTS
• megakernel::protocol::OPCODE_WORD
• megakernel::protocol::PRIORITY_WORD
• megakernel::protocol::SLOT_WORDS
• megakernel::protocol::STATUS_WORD
• megakernel::protocol::TENANT_WORD
• megakernel::protocol::control::DONE_COUNT
• megakernel::protocol::control::EPOCH
• megakernel::protocol::control::METRICS_BASE
• megakernel::protocol::control::METRICS_SLOTS
• megakernel::protocol::control::OBSERVABLE_BASE
• megakernel::protocol::control::PRIORITY_FAIRNESS_BASE
• megakernel::protocol::control::PRIORITY_FAIRNESS_SLOTS
• megakernel::protocol::control::PRIORITY_OFFSETS_BASE
• megakernel::protocol::control::PRIORITY_OFFSETS_SLOTS
• megakernel::protocol::control::PRIORITY_STARVATION_COUNTER
• megakernel::protocol::control::SHUTDOWN
• megakernel::protocol::control::TENANT_BASE
• megakernel::protocol::control::TENANT_FAIRNESS_BASE
• megakernel::protocol::control::TENANT_FAIRNESS_SLOTS
• megakernel::protocol::control::TENANT_QUOTA_BASE
• megakernel::protocol::debug::BUFFER_WORDS
• megakernel::protocol::debug::CURSOR_WORD
• megakernel::protocol::debug::RECORDS_BASE
• megakernel::protocol::debug::RECORD_CAPACITY
• megakernel::protocol::debug::RECORD_WORDS
• megakernel::protocol::opcode::ATOMIC_ADD
• megakernel::protocol::opcode::BATCH_FENCE
• megakernel::protocol::opcode::COMPARE_SWAP
• megakernel::protocol::opcode::DFA_STEP
• megakernel::protocol::opcode::EXPERT_LOAD_MISS
• megakernel::protocol::opcode::LOAD_MISS
• megakernel::protocol::opcode::LOAD_U32
• megakernel::protocol::opcode::MEMCPY
• megakernel::protocol::opcode::NOP
• megakernel::protocol::opcode::PACKED_SLOT
• megakernel::protocol::opcode::PRINTF
• megakernel::protocol::opcode::RESERVED_MAX_RANGE_MIN
• megakernel::protocol::opcode::SHUTDOWN
• megakernel::protocol::opcode::STORE_U32
• megakernel::protocol::opcode::SYSTEM_MASK
• megakernel::protocol::slot::CLAIMED
• megakernel::protocol::slot::DONE
• megakernel::protocol::slot::EMPTY
• megakernel::protocol::slot::FAULT
• megakernel::protocol::slot::PRIORITY_CRITICAL
• megakernel::protocol::slot::PRIORITY_HIGH
• megakernel::protocol::slot::PRIORITY_IDLE
• megakernel::protocol::slot::PRIORITY_LOW
• megakernel::protocol::slot::PRIORITY_NORMAL
• megakernel::protocol::slot::PUBLISHED
• megakernel::protocol::slot::REQUEUE
• megakernel::protocol::slot::WAIT_IO
• megakernel::protocol::slot::YIELD
• megakernel::ring::SLOT_BYTES
• megakernel::rule_catalog::ALPHABET_SIZE
• megakernel::rule_catalog::RULE_META_WORDS
• megakernel::scheduler::PRIORITY_LEVELS
• megakernel::scheduler::PRIORITY_OFFSETS_BASE
• megakernel::scheduler::PRIORITY_STARVATION_COUNTER
• megakernel::scheduler::STARVATION_THRESHOLD
• megakernel::scheduler::TENANT_FAIRNESS_THRESHOLD
• megakernel::scheduler::priority::CRITICAL
• megakernel::scheduler::priority::HIGH
• megakernel::scheduler::priority::IDLE
• megakernel::scheduler::priority::LOW
• megakernel::scheduler::priority::NORMAL
• megakernel::task::TASK_FLAG_PAUSED
• megakernel::task::TASK_FLAG_REQUEUE_REQUESTED
• megakernel::task::TASK_FLAG_RESUME_READY
• megakernel::task::TASK_FLAG_YIELDED
• megakernel::task::TASK_SLOT_BYTES
• megakernel::task::TASK_SLOT_WORDS
• tenant::OPCODE_RANGE_PER_TENANT
• tenant::TENANT_ID_MAX
• tenant::TENANT_OPCODE_BASE
• uring::gpudirect::NVME_CMD_READ
• uring::ring::IOSQE_FIXED_FILE
• uring::stream::IORING_OP_READV
• uring::stream::IORING_OP_READ_FIXED
• uring::stream::IORING_OP_URING_CMD