Struct Output 

pub struct Output {
    pub name: String,
    pub shape: Vec<i64>,
    /* private fields */
}

Output tensor of the model.

Must not outlive the parent Response.

Each output is a reference on a part of the output buffer (passed to request via Allocator) that contains the embedding. May be smaller than initial buffer, if Triton does not need whole buffer.

Fields

name: String

Name of the output tensor.

shape: Vec<i64>

Shape (dims) of the output tensor.

Implementations

impl Output

pub fn get_buffer(&self) -> &Buffer

Get the Buffer containing the inference result (embedding).

Safety

Do not mutate data of the returned value. If mutable (owned) Buffer is needed, use Response::return_buffers.

pub fn memory_type(&self) -> MemoryType

Get memory type of the output tensor.

pub fn data_type(&self) -> DataType

Get data type of the output tensor.

pub fn classification_label(&self, class: u64) -> Result<String, Error>

Get a classification label associated with the output.

Trait Implementations

impl Debug for Output

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Send for Output

impl Sync for Output