Enum PersistentMode 

pub enum PersistentMode {
    Grid,
    Persistent {
        num_sms: u32,
    },
}

Persistence mode for FA3. The v3 kernels can run as a single “persistent” grid that consumes a stream of work tiles, or as a classic per-tile grid. Persistent mode wins for short seqlens and loses for very long seqlens — callers pick based on workload.

Variants

Grid

Classic grid — one block per (batch, head, q-tile).

Persistent

Persistent — num_sms blocks; each consumes a tile-queue.

Fields

num_sms: u32

Trait Implementations

impl Clone for PersistentMode

fn clone(&self) -> PersistentMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PersistentMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for PersistentMode

fn eq(&self, other: &PersistentMode) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for PersistentMode

impl Eq for PersistentMode

impl StructuralPartialEq for PersistentMode