Skip to main content

SpeculationEngine

Struct SpeculationEngine 

Source
pub struct SpeculationEngine { /* private fields */ }
Expand description

Speculative execution engine.

Holds a reference to the underlying executor, the shared cache, and the active configuration. Create one instance per agent session and share via Arc.

§Examples

use std::sync::Arc;
use zeph_config::tools::SpeculativeConfig;
use zeph_core::agent::speculative::SpeculationEngine;

let config = SpeculativeConfig::default(); // mode = off
let engine = SpeculationEngine::new(executor, config);

Implementations§

Source§

impl SpeculationEngine

Source

pub fn new( executor: Arc<dyn ErasedToolExecutor>, config: SpeculativeConfig, ) -> Self

Create a new engine with the given executor and config.

Source

pub fn new_with_supervisor( executor: Arc<dyn ErasedToolExecutor>, config: SpeculativeConfig, supervisor: Option<Arc<TaskSupervisor>>, ) -> Self

Create a new engine with an optional session-level supervisor for task registration.

When supervisor is Some, the background sweeper and speculative dispatch tasks are registered for observability and graceful shutdown. Pass None in test harnesses.

Source

pub fn mode(&self) -> SpeculationMode

Current speculation mode.

Source

pub fn is_active(&self) -> bool

Returns true when speculation is not Off.

Source

pub fn try_dispatch( &self, prediction: &Prediction, trust_level: SkillTrustLevel, ) -> bool

Try to dispatch prediction speculatively.

Returns false when the call is skipped (not speculatable, trust gate, confirmation gate, or circuit-breaker). Returns true when the handle was inserted in the cache.

The confirmation check is performed via requires_confirmation_erased — a pure policy query that does not execute the tool (fixes C1: no double side-effects).

Source

pub async fn try_commit( &self, call: &ToolCall, ) -> Option<Result<Option<ToolOutput>, ToolError>>

Attempt to commit a speculative handle for call.

If a matching handle exists (same tool_id + args_hash), awaits its result and returns it. If no match, returns None — caller should fall through to normal dispatch.

Source

pub fn cancel_for(&self, tool_id: &ToolName)

Cancel and remove the in-flight handle for tool_id, if any.

Performs an actual cache lookup and task abort (fixes C3: was metrics-only no-op).

Source

pub fn end_turn(&self) -> SpeculativeMetrics

Cancel all in-flight handles at turn boundary and return metrics snapshot.

Source

pub fn metrics_snapshot(&self) -> SpeculativeMetrics

Snapshot current metrics without resetting.

Trait Implementations§

Source§

impl Drop for SpeculationEngine

Source§

fn drop(&mut self)

Executes the destructor for this type. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> IntoRequest<T> for T

Source§

fn into_request(self) -> Request<T>

Wrap the input message T in a tonic::Request
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more