Expand description
Runtime, memory, boundary, and reservation contracts for native execution.
Values defined in this module govern observable execution behavior across crates. Policy enum string representations, reservation fact keys, and retry fact keys are exposed to tests, telemetry reports, and adapter diagnostics. These identifiers constitute stable diagnostic contracts and are updated in coordination with reporting schemas.
Re-exports§
pub use cache::CacheGraphActivity;pub use cache::CacheSourceActivity;pub use cache::CacheSourceEventSnapshot;pub use cache::DeviceCacheReport;pub use cache::cache_observation_fingerprint;
Modules§
- cache
- GPU-resident cache ownership and lifecycle contracts.
- resident
- Frontend-neutral GPU-resident data and reusable build handles. Frontend-neutral GPU-resident data, result, and reusable build handles.
Structs§
- Admitted
Query Context - Execution context acquired from a
QueryHandle. - Backend
Admission Metrics Snapshot - Ledger-class backend metrics for one fixed device slot.
- Backend
Attempt Metrics Snapshot - Terminal counters and duration histograms for the complete backend.
- Backend
Device Metrics Snapshot - Metrics for one configured device. The ordinal is the bounded device-label value fixed during backend construction, never an attempt or query id.
- Backend
Diagnostics - One read of a live service’s state, each part taken under its owner’s lock. The device ledgers are the admission authority; cache, memory failure, and execution-pool reports are diagnostic cross-checks.
- Backend
Histogram Projection - An OTLP-compatible histogram projection. Bounds and
sumuse the descriptor-declared unit, while bucket counts are disjoint (including the final implicit+Infbucket). - Backend
Histogram Snapshot - A fixed cumulative histogram snapshot.
bucket_countsfollowsBACKEND_ATTEMPT_DURATION_BUCKETS_NSand ends with its+Infbucket. - Backend
Metric Attribute - One descriptor-ordered attribute of a projected backend metric sample.
- Backend
Metric Sample - One closed-label sample for a canonical backend descriptor.
- Backend
Metrics Snapshot - Coherent fixed-cardinality snapshot of one backend metrics generation.
- Cache
Fill Byte Permit - RAII permit for bytes charged to a cache-fill byte budget.
- Device
Capabilities - Immutable capability metadata for one installed CUDA device.
- Device
Capability - Stable identity of one device-execution capability required by a native attempt.
- Device
Facts - Snapshot of the stable facts algeon needs for one CUDA device.
- Device
Ledger Grant Row - One active grant row in
DeviceLedgerReport. - Device
Ledger Report - Public diagnostic report for one device ledger.
- Device
Memory Failure Report - Point-in-time device memory allocation-failure report.
- Device
Resource Profile - Frozen capacity and execution-slot bounds for one CUDA device.
- Device
Telemetry Snapshot - Live CUDA and NVML telemetry for one device.
- Execution
Cancellation - Shared cooperative cancellation token for native query execution.
- Execution
Context - Immutable execution configuration shared by native query execution.
- GpuBackend
Close Snapshot - Two-scope close state. GPU quiescence can become true while observation permits still exist; at that point the device-owner lease has been released.
- GpuBackend
Config - Backend construction input for the device set, the execution and queue policy, and the optional attempt completion queue.
- GpuBackend
Core - One process-owned GPU backend core.
- GpuBackend
Device Config - Pure per-device construction value binding a profile to deployment ownership.
- GpuBackend
Device Installation Bounds - Explicit installation limits for one device profile.
- GpuBackend
Device Profile - Pure per-device construction profile validated before owner acquisition.
- GpuBackend
Device Startup Record - Immutable per-device record frozen before backend publication.
- GpuBackend
Session - Opaque capability installed into session/optimizer state.
- GpuDevice
Capacity Probe - Pre-build capacity probe for one CUDA device.
- GpuExecution
Pool Snapshot - Point-in-time counters for one device’s GPU execution pool.
- GpuExecution
Query Snapshot - Point-in-time counters shared by a group of GPU execution pools.
- GpuExecutor
Lease - Opaque lifecycle-bound capability for synchronous GPU work.
- GpuMemory
Fraction - Validated automatic-capacity fraction retained unresolved until post-claim
device discovery. The private bit representation makes
Eq/Hashsound. NaN, infinities, zero, and out-of-range values cannot be constructed. - IoLifecycle
- One revocable I/O generation shared by native execution contexts.
- Kvikio
Process Config - KvikIO’s process-global settings: one thread pool and one task size shared by local compatibility-mode reads and remote range reads, across every device in the process.
- Lakehouse
Cache Fill Config - Service-wide resources used only by complete-object lakehouse cache fills.
- Query
Activity Lease - Opaque RAII token retained until query-service cleanup is complete.
- Query
Admission Request - Complete request-scoped metadata for one query-service admission attempt.
- Query
Execution Config - Execution policy copied into admitted native query contexts.
- Query
Handle - RAII admission handle for one native query.
- Query
Service Admission Snapshot - Point-in-time service admission state for bounded-queue and overload reports.
- Queue
Bounds - Bounded admission-queue policy.
- S3Source
Storage Profile - S3-compatible storage settings for source object-store fetches.
- Service
Stream Pool - Service-level CUDA stream pool for short-lived native worker tasks.
- Source
Scheduler Policy - Native source scheduling controls.
- Source
Storage Profile - Storage profile used by native remote reads and cache maintenance.
- Validated
GpuBackend Config - Configuration for
GpuBackendCore::newwith verified rules, resolved installation bounds, and devices ordered by ordinal.
Enums§
- Backend
Admission Health - Closed admission health projected from the owning ledger.
- Backend
Attempt Disposition - Closed disposition dimension of terminal backend-attempt metrics.
- Backend
Attempt Duration - Closed duration dimension for the attempt-duration histogram.
- Backend
Attempt Outcome - Closed outcome dimension of terminal backend-attempt metrics.
- Backend
Metric Attribute Value - A typed, closed backend-metric attribute value.
- Backend
Metric Projection Error - Projection failures that prevent an exporter from emitting a valid descriptor-owned backend metric.
- Backend
Metric Sample Value - One value produced by a backend descriptor projection.
- Device
Telemetry Status - Availability of one live device-telemetry substrate.
- GpuDevice
Memory Limit - Soft admission capacity calculation for one device.
- GpuExecution
JobKind - Classifies work submitted to the backend-owned GPU execution pool.
- GpuMemory
Ownership - Deployment ownership promised for one CUDA device.
- Kvikio
Compat Mode - KvikIO compatibility mode, the
KVIKIO_COMPAT_MODEsetting. - Memory
Resource Policy - S3Source
Storage Credential - Credential source for an S3 source storage profile.
Constants§
- BACKEND_
ATTEMPT_ DURATION_ BUCKET_ COUNT - Number of cumulative histogram buckets, including the final
+Infbucket. - BACKEND_
METRIC_ DEVICE_ CAPACITY - Maximum number of ordinal-addressable devices in one backend metrics store.
Functions§
- probe_
device_ capacity - Queries declarable capacity for one device without building a backend.