1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126
//! rten_tensor provides multi-dimensional arrays, commonly referred to as
//! _tensors_ in a machine learning context.
//!
//! Each tensor is a combination of data and a layout. The data can be owned,
//! borrowed or mutably borrowed. This is analagous to `Vec<T>`, `&[T]` and
//! `&mut [T]` for 1D arrays. The layout determines the number of dimensions
//! (the _rank_), the size of each dimension, and the strides (gap between
//! successive indices along a given dimension).
//!
//! # Key types and traits
//!
//! The base type for all tensors is [TensorBase]. This is not normally used
//! directly but instead via a type alias, depending on whether the number of
//! dimensions (the _rank_) of the tensor is known at compile time or only
//! at runtime, as well as whether the tensor owns, borrows or mutably borrows
//! its data.
//!
//! | Rank | Owned (like `Vec<T>`) | Borrowed (like `&[T]`) | Mutably borrowed |
//! | ---- | --------------------- | ---------------------- | ---------------- |
//! | Static | [NdTensor] | [NdTensorView] | [NdTensorViewMut] |
//! | Dynamic | [Tensor] | [TensorView] | [TensorViewMut] |
//!
//! All tensors implement the [Layout] trait, which provide methods to query
//! the shape, dimension count and strides of the tensor. Tensor views provide
//! various methods for indexing, iterating, slicing and transforming them.
//! The [AsView] trait provides access to these methods for owned and mutably
//! borrowed tensors. Conceptually it is similar to how [Deref](std::ops::Deref)
//! allows accesing methods for `&[T]` on a `Vec<T>`. The preferred way to
//! import the traits is via the prelude:
//!
//! ```
//! use rten_tensor::prelude::*;
//! use rten_tensor::NdTensor;
//!
//! let tensor = NdTensor::from([[1, 2], [3, 4]]);
//!
//! let transposed_elems: Vec<_> = tensor.transposed().iter().copied().collect();
//! assert_eq!(transposed_elems, [1, 3, 2, 4]);
//! ```
mod copy;
pub mod errors;
mod index_iterator;
mod iterators;
mod layout;
mod macros;
mod overlap;
mod slice_range;
mod storage;
mod tensor;
/// Trait for sources of random data for tensors, for use with [Tensor::rand].
pub trait RandomSource<T> {
/// Generate the next random value.
fn next(&mut self) -> T;
}
/// Storage allocation trait.
///
/// This is used by various methods on [TensorBase] with an `_in` suffix,
/// which allow the caller to control the allocation of the data buffer for
/// the returned owned tensor.
pub trait Alloc {
/// Allocate storage for an owned tensor.
///
/// The returned `Vec` should be empty but have the given capacity.
fn alloc<T>(&self, capacity: usize) -> Vec<T>;
}
impl<A: Alloc> Alloc for &A {
fn alloc<T>(&self, capacity: usize) -> Vec<T> {
A::alloc(self, capacity)
}
}
/// Implementation of [Alloc] which wraps the global allocator.
pub struct GlobalAlloc {}
impl GlobalAlloc {
pub const fn new() -> GlobalAlloc {
GlobalAlloc {}
}
}
impl Default for GlobalAlloc {
fn default() -> Self {
Self::new()
}
}
impl Alloc for GlobalAlloc {
fn alloc<T>(&self, capacity: usize) -> Vec<T> {
Vec::with_capacity(capacity)
}
}
pub use index_iterator::{DynIndices, Indices, NdIndices};
pub use iterators::{
AxisChunks, AxisChunksMut, AxisIter, AxisIterMut, InnerIter, InnerIterMut, Iter, IterMut,
Lanes, LanesMut,
};
pub use layout::{
is_valid_permutation, DynLayout, IntoLayout, Layout, MatrixLayout, MutLayout, NdLayout,
OverlapPolicy,
};
pub use slice_range::{to_slice_items, DynSliceItems, IntoSliceItems, SliceItem, SliceRange};
pub use tensor::{
AsView, Matrix, MatrixMut, NdTensor, NdTensorView, NdTensorViewMut, Tensor, TensorBase,
TensorView, TensorViewMut, WeaklyCheckedView,
};
pub use storage::{CowData, IntoStorage, Storage, StorageMut, ViewData, ViewMutData};
/// This module provides a convenient way to import the most common traits
/// from this library via a glob import.
pub mod prelude {
pub use super::{AsView, Layout};
}
// These modules are public for use by other crates in this repo, but
// currently considered internal to the project.
#[doc(hidden)]
pub mod rng;
#[doc(hidden)]
pub mod test_util;