Struct RecursiveChunkingOptions 

#[non_exhaustive]
pub struct RecursiveChunkingOptions {
    pub target_bytes: usize,
    pub overlap_bytes: usize,
    /* private fields */
}

Options for recursive separator-aware text splitting.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

target_bytes: usize

Maximum target bytes before choosing a preferred separator.

overlap_bytes: usize

Maximum source bytes repeated from the preceding window.

Implementations

impl RecursiveChunkingOptions

pub fn new( target_bytes: usize, overlap_bytes: usize, ) -> Result<Self, WorkspaceChunkingError>

pub fn with_separators<I, S>( self, separators: I, ) -> Result<Self, WorkspaceChunkingError>

where I: IntoIterator<Item = S>, S: Into<String>,

Override the prioritized separator list. Empty separators are rejected; a UTF-8-safe hard boundary is always the final fallback.

pub fn separators(&self) -> &[Arc<str>]

Trait Implementations

impl Clone for RecursiveChunkingOptions

fn clone(&self) -> RecursiveChunkingOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RecursiveChunkingOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for RecursiveChunkingOptions

impl PartialEq for RecursiveChunkingOptions

fn eq(&self, other: &RecursiveChunkingOptions) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for RecursiveChunkingOptions