pub struct Generation {
pub speculative_decoding: Option<SpeculativeDecoding>,
}Expand description
Generation capability declarations carried as package data.
Describes speculative-decoding capabilities of the source model only. It is never stage-selection or loader policy: which strategy actually runs is resolved from runtime configuration, and layer indices here must never be consulted by a stage selector.
Fields§
§speculative_decoding: Option<SpeculativeDecoding>Trait Implementations§
Source§impl Clone for Generation
impl Clone for Generation
Source§fn clone(&self) -> Generation
fn clone(&self) -> Generation
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for Generation
impl Debug for Generation
Source§impl<'de> Deserialize<'de> for Generation
impl<'de> Deserialize<'de> for Generation
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for Generation
Source§impl PartialEq for Generation
impl PartialEq for Generation
Source§impl Serialize for Generation
impl Serialize for Generation
impl StructuralPartialEq for Generation
Auto Trait Implementations§
impl Freeze for Generation
impl RefUnwindSafe for Generation
impl Send for Generation
impl Sync for Generation
impl Unpin for Generation
impl UnsafeUnpin for Generation
impl UnwindSafe for Generation
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more