pub struct MultimodalInputs {
pub mm_items: Vec<MultimodalDataItem>,
pub im_token_id: Option<i64>,
pub video_token_id: Option<i64>,
pub mrope_positions: Option<Tensor>,
pub mrope_position_delta: Option<Tensor>,
pub mrope_position_delta_scalar: Option<i64>,
pub mrope_position_delta_repeated_cache: Option<Tensor>,
}Expand description
The multimodal part of a request.
Fields§
§mm_items: Vec<MultimodalDataItem>The media items, in prompt order.
im_token_id: Option<i64>Image placeholder token id.
video_token_id: Option<i64>Video placeholder token id.
mrope_positions: Option<Tensor>M-RoPE position ids.
mrope_position_delta: Option<Tensor>M-RoPE position delta.
mrope_position_delta_scalar: Option<i64>M-RoPE position delta as a scalar.
mrope_position_delta_repeated_cache: Option<Tensor>Retired slot kept for arity; always None.
Trait Implementations§
Source§impl Clone for MultimodalInputs
impl Clone for MultimodalInputs
Source§impl Debug for MultimodalInputs
impl Debug for MultimodalInputs
Source§impl PartialEq for MultimodalInputs
impl PartialEq for MultimodalInputs
impl StructuralPartialEq for MultimodalInputs
Auto Trait Implementations§
impl !Freeze for MultimodalInputs
impl RefUnwindSafe for MultimodalInputs
impl Send for MultimodalInputs
impl Sync for MultimodalInputs
impl Unpin for MultimodalInputs
impl UnsafeUnpin for MultimodalInputs
impl UnwindSafe for MultimodalInputs
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more