#[non_exhaustive]pub enum SpeculativeMechanism {
Show 19 variants
TensorOperations,
NeuralOperations,
GroupedNeuralOperations,
HyperNeuralOperations,
PayloadMaterialization,
LogitsProcessing,
Sampling,
Randomness,
StateStorage,
StorageResidency,
ExactCompletion,
Observation,
Timing,
QueueBinding,
Communication,
Agreement,
Publication,
SameDeviceHandoff,
CrossDeviceTransfer,
}Expand description
Generic backend mechanism needed by speculative composition.
Variants (Non-exhaustive)§
This enum is marked as non-exhaustive
TensorOperations
Backend-native tensor indexing, concatenation, and shape-preserving movement.
NeuralOperations
General neural operators needed to construct and execute the target or draft.
GroupedNeuralOperations
Routed or grouped neural operators required by a selected model family.
HyperNeuralOperations
Hyper-connection and hyper-head operators required by a selected model family.
PayloadMaterialization
Checkpoint payload decoding and backend-native parameter materialization.
LogitsProcessing
Generic logits processing and probability construction.
Sampling
Generic categorical or deterministic token selection.
Randomness
Forkable random state and stable random substreams.
StateStorage
Architecture-shaped prediction or assistant state storage.
StorageResidency
Placement and residency of materialized payload and mutable speculative state.
ExactCompletion
Exact completion retaining submitted resources.
Observation
Architecture-declared activation observation and replacement.
Timing
Component timing collection and attribution.
QueueBinding
Native target and draft execution queue binding.
Communication
Communication required by an architecture-declared distributed realization.
Agreement
Exact target/draft agreement before canonical state is committed.
Publication
Publication of only canonically committed tokens and semantic events.
SameDeviceHandoff
Ordered handoff between distinct queues on one device.
CrossDeviceTransfer
Shape- and dtype-preserving transfer between devices.
Trait Implementations§
Source§impl Clone for SpeculativeMechanism
impl Clone for SpeculativeMechanism
Source§fn clone(&self) -> SpeculativeMechanism
fn clone(&self) -> SpeculativeMechanism
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read more