Struct ParallelConfig 

pub struct ParallelConfig {
    pub parallel_batch: bool,
    pub parallel_heads: bool,
    pub min_batch_size: usize,
    pub min_vector_size: usize,
}

Configuration for parallel execution

Fields

parallel_batch: bool

Enable parallel batch processing

parallel_heads: bool

Enable parallel layer computation (for independent heads)

min_batch_size: usize

Minimum batch size to trigger parallel processing

min_vector_size: usize

Minimum vector size for parallel operations

Implementations

impl ParallelConfig

pub fn throughput() -> Self

Create configuration optimized for throughput

pub fn latency() -> Self

Create configuration optimized for latency (less parallelism)

pub fn should_parallel_batch(&self, batch_size: usize) -> bool

Should use parallel batch processing for this batch size?

pub fn should_parallel_heads(&self, num_heads: usize) -> bool

Should use parallel heads for this number of heads?

Trait Implementations

impl Clone for ParallelConfig

fn clone(&self) -> ParallelConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ParallelConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ParallelConfig

fn default() -> Self

Returns the “default value” for a type.