pub enum AttentionExecutionPolicy {
Auto,
Portable,
NativeAdaptive,
}Expand description
Product policy for selecting an attention provider implementation.
The policy selects a provider family, not a fixed kernel. An adaptive provider may select different physical variants for each invocation based on the admitted shape and sequence frontier.
Variants§
Auto
Resolve to the best compiled provider family at composition time.
Portable
Use the portable backend implementation and avoid optional native accelerator libraries.
NativeAdaptive
Use a compiled native provider with invocation-shape selection.
Implementations§
Source§impl AttentionExecutionPolicy
impl AttentionExecutionPolicy
pub const fn as_runtime_value(self) -> &'static str
pub fn parse_runtime_value(raw: &str) -> Result<Self, String>
Sourcepub fn resolve(self, native_adaptive_supported: bool) -> Result<Self, String>
pub fn resolve(self, native_adaptive_supported: bool) -> Result<Self, String>
Resolves the product request into the policy sealed into the runtime policy and provider descriptor.
pub const fn is_resolved(self) -> bool
Trait Implementations§
Source§impl Clone for AttentionExecutionPolicy
impl Clone for AttentionExecutionPolicy
Source§fn clone(&self) -> AttentionExecutionPolicy
fn clone(&self) -> AttentionExecutionPolicy
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for AttentionExecutionPolicy
Source§impl Debug for AttentionExecutionPolicy
impl Debug for AttentionExecutionPolicy
Source§impl Default for AttentionExecutionPolicy
impl Default for AttentionExecutionPolicy
Source§impl<'de> Deserialize<'de> for AttentionExecutionPolicy
impl<'de> Deserialize<'de> for AttentionExecutionPolicy
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for AttentionExecutionPolicy
Source§impl PartialEq for AttentionExecutionPolicy
impl PartialEq for AttentionExecutionPolicy
Source§impl Serialize for AttentionExecutionPolicy
impl Serialize for AttentionExecutionPolicy
impl StructuralPartialEq for AttentionExecutionPolicy
Auto Trait Implementations§
impl Freeze for AttentionExecutionPolicy
impl RefUnwindSafe for AttentionExecutionPolicy
impl Send for AttentionExecutionPolicy
impl Sync for AttentionExecutionPolicy
impl Unpin for AttentionExecutionPolicy
impl UnsafeUnpin for AttentionExecutionPolicy
impl UnwindSafe for AttentionExecutionPolicy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more