pub enum SpeculationMode {
Off,
Decoding,
Pattern,
Both,
}Expand description
Speculative tool execution mode.
Controls whether and how the agent pre-dispatches tool calls before the LLM finishes decoding the full tool-use block.
Variants§
Off
No speculation; uses existing synchronous path.
Decoding
LLM-decoding level: fires tools when streaming partial JSON has all required fields.
Pattern
Application-level pattern (PASTE): predicts top-K calls from SQLite history.
Both
Both decoding and pattern speculation active.
Trait Implementations§
Source§impl Clone for SpeculationMode
impl Clone for SpeculationMode
Source§fn clone(&self) -> SpeculationMode
fn clone(&self) -> SpeculationMode
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for SpeculationMode
impl Debug for SpeculationMode
Source§impl Default for SpeculationMode
impl Default for SpeculationMode
Source§fn default() -> SpeculationMode
fn default() -> SpeculationMode
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for SpeculationMode
impl<'de> Deserialize<'de> for SpeculationMode
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for SpeculationMode
impl PartialEq for SpeculationMode
Source§impl Serialize for SpeculationMode
impl Serialize for SpeculationMode
impl Copy for SpeculationMode
impl Eq for SpeculationMode
impl StructuralPartialEq for SpeculationMode
Auto Trait Implementations§
impl Freeze for SpeculationMode
impl RefUnwindSafe for SpeculationMode
impl Send for SpeculationMode
impl Sync for SpeculationMode
impl Unpin for SpeculationMode
impl UnsafeUnpin for SpeculationMode
impl UnwindSafe for SpeculationMode
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more