pub struct FlashArmCapability {
pub cuda_flash_kernel: bool,
pub cuda_in_topology: bool,
}Expand description
The capability + topology gate for the CUDA flash decode arm: a CUDA
FlashAttn kernel must be bound and a CUDA device must be present
in the current topology. Split out (and injectable) so the gate logic is
unit-testable without a CUDA build, while production reads the real
process-global registry + topology via Self::production.
Fields§
§cuda_flash_kernel: boolA (FlashAttn, Cuda) kernel is bound (static or runtime-adopted).
cuda_in_topology: boolA CUDA device is present in the current SystemTopology.
Implementations§
Source§impl FlashArmCapability
impl FlashArmCapability
Sourcepub fn production() -> Self
pub fn production() -> Self
Read the real process-global capability.
Trait Implementations§
Source§impl Clone for FlashArmCapability
impl Clone for FlashArmCapability
impl Copy for FlashArmCapability
Auto Trait Implementations§
impl Freeze for FlashArmCapability
impl RefUnwindSafe for FlashArmCapability
impl Send for FlashArmCapability
impl Sync for FlashArmCapability
impl Unpin for FlashArmCapability
impl UnsafeUnpin for FlashArmCapability
impl UnwindSafe for FlashArmCapability
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more