Struct ChunkParams 

pub struct ChunkParams {
    pub model: String,
    pub max_tokens: u32,
    pub overlap: u32,
}

Chunking parameters

Fields

model: String

The name of the model the chunk is intended to be used for. This must be a known model.

max_tokens: u32

The maximum number of tokens that should be returned per chunk.

overlap: u32

The amount of allowed overlap between chunks. overlap must be less than max-tokens.

Implementations

impl ChunkParams

pub fn new(model: impl Into<String>, max_tokens: u32) -> Self

pub fn with_overlap(self, overlap: u32) -> Self

Trait Implementations

impl Clone for ChunkParams

fn clone(&self) -> ChunkParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChunkParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for ChunkParams

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.