pub enum AuxiliaryModelKind {
DraftModel,
}Expand description
The governed auxiliary weight artifact kinds a serve declaration may attach ([[RFC-0003:C-SERVE-AUXILIARY-MODELS]]).
Variants§
DraftModel
Separate weights the operator’s framework speculative decoding configuration consumes as its draft.
Trait Implementations§
Source§impl Clone for AuxiliaryModelKind
impl Clone for AuxiliaryModelKind
Source§fn clone(&self) -> AuxiliaryModelKind
fn clone(&self) -> AuxiliaryModelKind
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for AuxiliaryModelKind
Source§impl Debug for AuxiliaryModelKind
impl Debug for AuxiliaryModelKind
Source§impl<'de> Deserialize<'de> for AuxiliaryModelKind
impl<'de> Deserialize<'de> for AuxiliaryModelKind
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for AuxiliaryModelKind
Source§impl JsonSchema for AuxiliaryModelKind
impl JsonSchema for AuxiliaryModelKind
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Returns a string that uniquely identifies the schema produced by this type. Read more
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Generates a JSON Schema for this type. Read more
Source§fn inline_schema() -> bool
fn inline_schema() -> bool
Whether JSON Schemas generated for this type should be included directly in parent schemas,
rather than being re-used where possible using the
$ref keyword. Read moreSource§impl PartialEq for AuxiliaryModelKind
impl PartialEq for AuxiliaryModelKind
Source§impl Serialize for AuxiliaryModelKind
impl Serialize for AuxiliaryModelKind
impl StructuralPartialEq for AuxiliaryModelKind
Auto Trait Implementations§
impl Freeze for AuxiliaryModelKind
impl RefUnwindSafe for AuxiliaryModelKind
impl Send for AuxiliaryModelKind
impl Sync for AuxiliaryModelKind
impl Unpin for AuxiliaryModelKind
impl UnsafeUnpin for AuxiliaryModelKind
impl UnwindSafe for AuxiliaryModelKind
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more