pub enum Speculative {
Off,
Auto,
Draft,
Ngram,
}Expand description
Speculative decoding: draft uses the catalog drafter, ngram drafts from the
context itself, and auto resolves to draft or off before launch.
Variants§
Implementations§
Trait Implementations§
Source§impl Clone for Speculative
impl Clone for Speculative
impl Copy for Speculative
Source§impl Debug for Speculative
impl Debug for Speculative
Source§impl Default for Speculative
impl Default for Speculative
Source§impl<'de> Deserialize<'de> for Speculative
impl<'de> Deserialize<'de> for Speculative
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for Speculative
Source§impl PartialEq for Speculative
impl PartialEq for Speculative
Source§impl Serialize for Speculative
impl Serialize for Speculative
impl StructuralPartialEq for Speculative
Auto Trait Implementations§
impl Forget for Speculative
impl Freeze for Speculative
impl RefUnwindSafe for Speculative
impl Send for Speculative
impl Sync for Speculative
impl Unpin for Speculative
impl UnsafeUnpin for Speculative
impl UnwindSafe for Speculative
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.