Enum PoolingMode 

pub enum PoolingMode {
    Last,
    Mean,
    Max,
    Cls,
}

Strategy for collapsing a sequence of hidden states into a single vector.

The default mode is PoolingMode::Last, which is appropriate for causal LLMs (the last token’s hidden state encodes the full context).

Variants

Last

Return the hidden state of the last token in the sequence.

Shape: states[(seq_len - 1) * hidden_size .. seq_len * hidden_size]. This is the natural pooling choice for causal / decoder-only models.

Mean

Elementwise arithmetic mean across all seq_len token hidden states.

result[j] = (1 / seq_len) * Σ_{i=0}^{seq_len-1} states[i * hidden_size + j]

Max

Elementwise maximum across all seq_len token hidden states.

result[j] = max_{i=0..seq_len-1} states[i * hidden_size + j]

Cls

Return the hidden state of the first token (CLS position).

Shape: states[0 .. hidden_size]. This is the standard pooling choice for BERT-style encoder models.

Trait Implementations

impl Clone for PoolingMode

fn clone(&self) -> PoolingMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PoolingMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for PoolingMode

fn default() -> PoolingMode

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for PoolingMode

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for PoolingMode

fn eq(&self, other: &PoolingMode) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for PoolingMode

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for PoolingMode

impl Eq for PoolingMode

impl StructuralPartialEq for PoolingMode