Struct IRotaryEmbeddingLayer 

pub struct IRotaryEmbeddingLayer { /* private fields */ }

IRotaryEmbeddingLayer

Layer that implements Rotary Position Embedding (RoPE) (https://arxiv.org/abs/2104.09864).

Do not inherit from this class, as doing so will break forward-compatibility of the API and ABI.

Implementations

impl IRotaryEmbeddingLayer

pub fn setInterleaved(self: Pin<&mut IRotaryEmbeddingLayer>, interleaved: bool)

Set whether the input is in interleaved format, i.e., whether the 2-d vectors rotated are taken from adjacent 2 elements in the hidden dimension. The default value is false.

See [getInterleaved]

pub fn getInterleaved(self: &IRotaryEmbeddingLayer) -> bool

Get whether the input is in interleaved format. The default value is false.

See [setInterleaved]

pub fn setRotaryEmbeddingDim( self: Pin<&mut IRotaryEmbeddingLayer>, rotaryEmbeddingDim: i32, ) -> bool

Set the number of hidden dimensions participating in RoPE. The default value is 0, representing H, i.e., all hidden dimensions in each head. Must be non-negative and even.

See [getRotaryEmbeddingDim]

pub fn getRotaryEmbeddingDim(self: &IRotaryEmbeddingLayer) -> i32

Get the number of hidden dimensions participating in RoPE. The default value is 0, representing H, i.e., all hidden dimensions in each head.

See [setRotaryEmbeddingDim]

Trait Implementations

impl AsLayer for IRotaryEmbeddingLayer

fn as_layer(&self) -> &ILayer

fn as_layer_pin_mut(&mut self) -> Pin<&mut ILayer>

impl AsLayerTyped for IRotaryEmbeddingLayer

const TYPE: LayerType = LayerType::kROTARY_EMBEDDING

impl AsRef<ILayer> for IRotaryEmbeddingLayer

fn as_ref(self: &IRotaryEmbeddingLayer) -> &ILayer

Converts this type into a shared reference of the (usually inferred) input type.

impl ExternType for IRotaryEmbeddingLayer

type Id = (n, v, i, n, f, e, r, _1, (), I, R, o, t, a, r, y, E, m, b, e, d, d, i, n, g, L, a, y, e, r)

A type-level representation of the type’s C++ namespace and type name.

type Kind = Opaque

Either cxx::kind::Opaque or cxx::kind::Trivial.

impl MakeCppStorage for IRotaryEmbeddingLayer

unsafe fn allocate_uninitialized_cpp_storage() -> *mut IRotaryEmbeddingLayer

Allocates heap space for this type in C++ and return a pointer to that space, but do not initialize that space (i.e. do not yet call a constructor).

unsafe fn free_uninitialized_cpp_storage(arg0: *mut IRotaryEmbeddingLayer)

Frees a C++ allocation which has not yet had a constructor called.