bunsen 0.40.0

bunsen is a batteries included common library for burn
Documentation
//! # Embedding blocks
//!
//! - [`RotaryEmbedding`] is rotary position embedding (`RoPE`) as a module.
//!   Built by [`RotaryEmbeddingConfig`], it caches the `cos` and `sin` of
//!   [`positional_frequency_table`] as bare tensors (no parameters).
//!   [`apply`](RotaryEmbedding::apply) rotates a `[B, T, H, D]` query or key,
//!   and [`clip_range`](RotaryEmbedding::clip_range) narrows the tables to the
//!   positions of a decode step. [`CausalSelfAttention`] takes one in its
//!   `forward`; the `NanoChat` GPT holds one as a field of its module tree.
//! - [`iota_embedding`] and [`identity_embedding`] build burn [`Embedding`]s
//!   with weights you can check by hand, as fixtures for tests.
//!
//! The table builders, and [`unembed`] for a tied output head, are operations
//! in [`crate::ops::embedding`].
//!
//! [`positional_frequency_table`]: crate::ops::embedding::positional_frequency_table
//! [`unembed`]: crate::ops::embedding::unembed
//! [`CausalSelfAttention`]: crate::blocks::transformers::attention::csa::CausalSelfAttention
//! [`Embedding`]: burn::nn::Embedding

mod rotary;
mod trivial_builders;

pub use rotary::*;
pub use trivial_builders::*;