Struct SparseAttentionConfigBuilder 

pub struct SparseAttentionConfigBuilder { /* private fields */ }

Builder for SparseAttentionConfig.

Implementations

impl SparseAttentionConfigBuilder

pub fn dim(self, dim: usize) -> Self

Sets the model dimension.

pub fn num_heads(self, num_heads: usize) -> Self

Sets the number of attention heads.

pub fn block_size(self, block_size: usize) -> Self

Sets the block size.

pub fn num_random_blocks(self, num_random_blocks: usize) -> Self

Sets the number of random blocks.

pub fn num_global_tokens(self, num_global_tokens: usize) -> Self

Sets the number of global tokens.

pub fn build(self) -> AttentionResult<SparseAttentionConfig>

Builds the SparseAttentionConfig.

Trait Implementations

impl Default for SparseAttentionConfigBuilder

fn default() -> SparseAttentionConfigBuilder

Returns the “default value” for a type.