Enum Batch 

#[repr(u32)]
pub enum Batch {
    Unknown = 1,
    FirstDim = 2,
}

Batch properties of the model.

Variants

Unknown = 1

Triton cannot determine the batching properties of the model. This means that the model does not support batching in any way that is useable by Triton.

FirstDim = 2

The model supports batching along the first dimension of every input and output tensor. Triton schedulers that perform batching can automatically batch inference requests along this dimension.

Trait Implementations

impl Clone for Batch

fn clone(&self) -> Batch

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Batch

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for Batch

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for Batch

fn eq(&self, other: &Batch) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Batch

impl Eq for Batch

impl StructuralPartialEq for Batch