Struct MtmdInputChunk 

pub struct MtmdInputChunk {
    pub chunk: NonNull<mtmd_input_chunk>,
    pub owned: bool,
}

Fields

chunk: NonNull<mtmd_input_chunk>

owned: bool

Implementations

impl MtmdInputChunk

pub fn chunk_type(&self) -> Result<MtmdInputChunkType, MtmdInputChunkTypeError>

Errors

Returns an error if the chunk type is unknown.

pub fn text_tokens(&self) -> Option<&[LlamaToken]>

pub fn n_tokens(&self) -> usize

pub fn n_positions(&self) -> i32

pub fn id(&self) -> Option<String>

pub fn copy(&self) -> Result<Self, MtmdInputChunkError>

Errors

Returns MtmdInputChunkError::ChunkOperationFailed if copying fails.

pub fn eval_single( &self, mtmd_ctx: &MtmdContext, llama_ctx: &LlamaContext<'_>, start_position: llama_pos, seq_id: llama_seq_id, n_batch: i32, logits_last: bool, ) -> Result<llama_pos, MtmdEvalError>

Errors

Returns MtmdEvalError::ImageChunkExceedsBatchSize when this is an image chunk whose token count exceeds n_batch. Returns [MtmdEvalError::EvalFailure] if the underlying encode or decode step fails.

Trait Implementations

impl Debug for MtmdInputChunk

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for MtmdInputChunk

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.