Struct Transformer 

pub struct Transformer { /* private fields */ }

Transformer block with causal self attention and several caching strategies.

Trait Implementations

impl Clone for Transformer

fn clone(&self) -> Transformer

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Transformer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Transformer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Forwarder for Transformer

fn load(name: String, ctx: &Context) -> Result<Box<Self>>

Create an instance of this object loading the specified layer(s) from a VarBuilder.

fn forward<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, x: &'life1 Tensor, index_pos: usize, block_idx: usize, ctx: &'life2 mut Context, ) -> Pin<Box<dyn Future<Output = Result<Tensor>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Applies a forward operation to the input tensor, does not require mutability.

fn forward_mut<'life0, 'life1, 'life2, 'async_trait>( &'life0 mut self, x: &'life1 Tensor, index_pos: usize, block_idx: usize, ctx: &'life2 mut Context, ) -> Pin<Box<dyn Future<Output = Result<Tensor>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Applies a forward operation to the input tensor, requires mutability.

fn layer_name(&self) -> &str

Return the layer name.

fn forward_batch<'life0, 'life1, 'life2, 'async_trait>( &'life0 mut self, _x: &'life1 Tensor, _batch: Vec<(String, usize, usize)>, _ctx: &'life2 mut Context, ) -> Pin<Box<dyn Future<Output = Result<Tensor>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Applies a batch of forward operations to the input tensor.

fn goodbye<'life0, 'async_trait>( &'life0 mut self, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

fn ident(&self) -> &str

Return the unique identity or local.