Struct RouterTensor 

pub struct RouterTensor<C: RunnerClient> {
    pub client: C,
    /* private fields */
}

Tensor primitive for the router backend.

Fields

client: C

The client that has this tensor

Implementations

impl<C: RunnerClient> RouterTensor<C>

pub fn new(id: TensorId, shape: Shape, dtype: DType, client: C) -> Self

Create a new router tensor.

pub fn into_ir(self) -> TensorIr

Get the ir for this tensor

Trait Implementations

impl<C: RunnerClient> Clone for RouterTensor<C>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<C: RunnerClient> Debug for RouterTensor<C>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<C: RunnerClient> Drop for RouterTensor<C>

fn drop(&mut self)

Executes the destructor for this type.

impl<R: RunnerClient> QTensorPrimitive for RouterTensor<R>

fn scheme(&self) -> &QuantScheme

Returns the quantization settings for the given tensor.

fn acc_precision(&self) -> QuantAcc

The precision used for the accumulation in various kernels.

fn propagation(&self) -> QuantPropagation

How quantization is propagated during computation.

fn default_scheme() -> QuantScheme

Returns the default tensor quantization scheme.

impl<C: RunnerClient> TensorMetadata for RouterTensor<C>

fn dtype(&self) -> DType

The dtype of the tensor.

fn shape(&self) -> Shape

The shape of the tensor.

fn rank(&self) -> usize

The number of dimensions of the tensor.