Struct StaticChunkingStrategy

pub struct StaticChunkingStrategy {
    pub chunk_overlap_tokens: i32,
    pub max_chunk_size_tokens: i32,
}

Fields

chunk_overlap_tokens: i32

The number of tokens that overlap between chunks. The default value is 400. Note that the overlap must not exceed half of max_chunk_size_tokens.

max_chunk_size_tokens: i32

The maximum number of tokens in each chunk. The default value is 800. The minimum value is 100 and the maximum value is 4096.

Trait Implementations

impl Debug for StaticChunkingStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for StaticChunkingStrategy

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for StaticChunkingStrategy

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.