pub enum KernelType {
Show 15 variants
TiledQ4K,
CoalescedQ4K,
VectorizedQ4K,
BatchedQ4K,
Dp4aQ4K,
FusedRmsNormQ4K,
CoalescedQ6K,
IncrementalAttention,
MultiWarpAttention,
BatchedAttention,
RmsNorm,
VectorizedRmsNorm,
BatchedRmsNorm,
Generic,
Unknown,
}Expand description
Kernel type for feature encoding.
Variants§
TiledQ4K
CoalescedQ4K
VectorizedQ4K
BatchedQ4K
Dp4aQ4K
FusedRmsNormQ4K
CoalescedQ6K
IncrementalAttention
MultiWarpAttention
BatchedAttention
RmsNorm
VectorizedRmsNorm
BatchedRmsNorm
Generic
Unknown
Implementations§
Trait Implementations§
Source§impl Clone for KernelType
impl Clone for KernelType
Source§fn clone(&self) -> KernelType
fn clone(&self) -> KernelType
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for KernelType
impl Debug for KernelType
Source§impl Default for KernelType
impl Default for KernelType
Source§fn default() -> KernelType
fn default() -> KernelType
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for KernelType
impl<'de> Deserialize<'de> for KernelType
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Hash for KernelType
impl Hash for KernelType
Source§impl PartialEq for KernelType
impl PartialEq for KernelType
Source§impl Serialize for KernelType
impl Serialize for KernelType
impl Copy for KernelType
impl Eq for KernelType
impl StructuralPartialEq for KernelType
Auto Trait Implementations§
impl Freeze for KernelType
impl RefUnwindSafe for KernelType
impl Send for KernelType
impl Sync for KernelType
impl Unpin for KernelType
impl UnwindSafe for KernelType
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.