Struct MultimodalDataItem 

pub struct MultimodalDataItem {
    pub modality: Modality,
    pub hash: Option<u64>,
    pub pad_value: Option<i64>,
    pub offsets: Option<Vec<(i64, i64)>>,
    pub feature: Option<Tensor>,
    pub feature_shm: Option<ShmTensorHandle>,
    pub model_specific_data: Dict<String, Tensor>,
    pub encoded: Option<Tensor>,
    pub encoded_deepstack: Option<Tensor>,
    pub encode_handshake: Option<Dict<Value, Value>>,
}

One image, video or audio item of a request.

Fields

modality: Modality

Media kind.

hash: Option<u64>

Content id used for prefix matching; up to 64 bits.

pad_value: Option<i64>

The placeholder token id substituted into the prompt.

offsets: Option<Vec<(i64, i64)>>

(start, end) token ranges of the item in the prompt.

feature: Option<Tensor>

Inline feature tensor. Exactly one of feature and feature_shm is set in flight.

feature_shm: Option<ShmTensorHandle>

Feature tensor in shared memory.

model_specific_data: Dict<String, Tensor>

Model-specific tensors, such as image grid sizes.

encoded: Option<Tensor>

Engine-local encoder output; always None on the wire.

encoded_deepstack: Option<Tensor>

Engine-local deepstack encoder output; always None on the wire.

encode_handshake: Option<Dict<Value, Value>>

EPD: the encode worker’s rendezvous for this item’s embedding.

Trait Implementations

impl Clone for MultimodalDataItem

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MultimodalDataItem

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for MultimodalDataItem

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for MultimodalDataItem

impl Wire for MultimodalDataItem

fn encode(&self, encoder: &mut Encoder)

Append this value to a message.

fn decode(decoder: &mut Decoder<'_>) -> Result<Self>

Read one value of this type.