Module positional_encoding

Positional encoding utilities for transformer models

This module provides implementations of positional encoding techniques used in transformer architectures to incorporate sequence order information.

Structs

LearnedPositionalEncoding

Learned positional embeddings

PositionalEncodingFactory

Factory for creating positional encodings

RelativePositionalEncoding

Relative positional encoding

SinusoidalPositionalEncoding

Sinusoidal positional encoding from the “Attention Is All You Need” paper

Enums

PositionalEncodingType

Types of positional encoding available

Traits

PositionalEncoding

Trait for positional encoding implementations