pub enum VerificationStrategy {
Greedy,
Stochastic {
temperature: f32,
},
}Expand description
Strategy for accepting or rejecting proposed speculative tokens.
Variants§
Greedy
Greedy decoding: Accept candidate if and only if target argmax == draft token.
Stochastic
Stochastic rejection sampling adhering to Leviathan et al. (2023). Guarantees that the resulting token stream strictly follows the target model’s probability distribution.
Trait Implementations§
Source§impl Clone for VerificationStrategy
impl Clone for VerificationStrategy
Source§fn clone(&self) -> VerificationStrategy
fn clone(&self) -> VerificationStrategy
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for VerificationStrategy
Source§impl Debug for VerificationStrategy
impl Debug for VerificationStrategy
Source§impl PartialEq for VerificationStrategy
impl PartialEq for VerificationStrategy
impl StructuralPartialEq for VerificationStrategy
Auto Trait Implementations§
impl Forget for VerificationStrategy
impl Freeze for VerificationStrategy
impl Move for VerificationStrategy
impl RefUnwindSafe for VerificationStrategy
impl Send for VerificationStrategy
impl Sync for VerificationStrategy
impl Unpin for VerificationStrategy
impl UnsafeUnpin for VerificationStrategy
impl UnwindSafe for VerificationStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more