Struct MtmdInputChunks 

pub struct MtmdInputChunks {
    pub chunks: NonNull<mtmd_input_chunks>,
}

Fields

chunks: NonNull<mtmd_input_chunks>

Implementations

impl MtmdInputChunks

pub fn new() -> Result<Self, MtmdInputChunksError>

Errors

Returns MtmdInputChunksError::ChunksCreationFailed if the underlying llama.cpp function returns null.

pub fn len(&self) -> usize

pub fn is_empty(&self) -> bool

pub fn get(&self, index: usize) -> Option<MtmdInputChunk>

pub fn total_tokens(&self) -> usize

pub fn total_positions(&self) -> i32

pub fn eval_chunks( &self, mtmd_ctx: &MtmdContext, llama_ctx: &LlamaContext<'_>, start_position: llama_pos, seq_id: llama_seq_id, n_batch: i32, logits_last: bool, ) -> Result<llama_pos, MtmdEvalError>

Errors

Returns MtmdEvalError::EvalFailure if any encoding or decoding operation fails.

Trait Implementations

impl Debug for MtmdInputChunks

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for MtmdInputChunks

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.