syntaxdot_transformers::models

Module sinusoidal

Source
Expand description

Word embeddings with sinusoidal position embeddings.

Structsยง

SinusoidalEmbeddings
Embeddings layer that uses word embeddings with sinusoidal positions.