Struct RunSpeculativeGeneration 

pub struct RunSpeculativeGeneration { /* private fields */ }

Facade-selected speculative generation driver.

Backends lend prepared native resources through SpeculativeGenerationVisitor. This driver alone registers lanes, runs the fair schedule, observes exact completions, and constructs public terminal outputs.

Implementations

impl RunSpeculativeGeneration

pub const fn new(options: SpeculativeSchedulerOptions) -> Self

Creates a driver with facade-selected scheduling and lookahead controls.

Trait Implementations

impl Clone for RunSpeculativeGeneration

fn clone(&self) -> RunSpeculativeGeneration

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for RunSpeculativeGeneration

impl Debug for RunSpeculativeGeneration

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RunSpeculativeGeneration

fn default() -> RunSpeculativeGeneration

Returns the “default value” for a type.

impl SpeculativeGenerationVisitor for RunSpeculativeGeneration

fn run<'a, E, S, C, P>( self, executor: &'a mut E, lanes: Vec<PreparedSpeculativeLane<'a, E, S, C, P>>, topology: SpeculativeExecutionTopology, optimistic_execution_available: bool, component_timings_collected: bool, context: E::Context<'a>, ) -> Result<SpeculativeGenerationBatchOutput, SpeculativeDriverError<E::Error>>

where E: SpeculativeExecutor + 'a, S: SpeculativeSampling<Logits = E::Logits, Error = E::Error, Context<'a> = E::Context<'a>> + 'a, C: SpeculativeConstraint, P: SpeculativePublisher<C>,

Drives one prepared set of lanes through the neutral lifecycle.