Struct TensorCache 

pub struct TensorCache { /* private fields */ }

A growable tensor cache. This cache wraps candles [Cache] with exponentially larger allocations as the sequence length increases.

Implementations

impl TensorCache

pub fn new(concat_dim: usize, max_seq_len: usize) -> Self

Create a new cache with the given max sequence length.

pub fn cache(&self) -> &Cache

Get the raw cache.

pub fn cache_mut(&mut self) -> &mut Cache

Get the raw cache mutably.

pub fn all_data(&self) -> &Option<Tensor>

Get the current tensor in the cache.

pub fn reset(&mut self)

Reset the cache.

pub fn append(&mut self, v: &Tensor) -> Result<()>

Append a new value to the cache.

Trait Implementations

impl Clone for TensorCache

fn clone(&self) -> TensorCache

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TensorCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.