Struct OwnedMtmdInputChunk 

pub struct OwnedMtmdInputChunk { /* private fields */ }

A chunk that owns its allocation, as returned by MtmdInputChunks::load_chunk or MtmdInputChunk::to_placeholder.

MtmdInputChunk borrows from the MtmdInputChunks list that holds it; this one stands alone and frees itself on drop.

Implementations

impl OwnedMtmdInputChunk

pub fn chunk_type(&self) -> MtmdInputChunkType

The type of this chunk.

pub fn n_tokens(&self) -> usize

Total number of tokens in this chunk.

pub fn n_pos(&self) -> i32

Number of temporal positions.

pub fn save(&self) -> Result<Vec<u8>>

Serialize this chunk’s metadata, as MtmdInputChunk::save does.

Errors

Returns MtmdError::ChunkSaveFailed if llama.cpp cannot serialize it.

Trait Implementations

impl Debug for OwnedMtmdInputChunk

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for OwnedMtmdInputChunk

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.