pub struct SemanticChunkConfig {
pub target_size: usize,
pub min_size: usize,
pub max_size: usize,
pub similarity_threshold: f32,
pub overlap: usize,
pub fallback_to_sentences: bool,
}Expand description
Configuration for semantic chunking.
Fields§
§target_size: usizeTarget chunk size in characters (soft limit)
min_size: usizeMinimum chunk size in characters (hard limit)
max_size: usizeMaximum chunk size in characters (hard limit)
similarity_threshold: f32Similarity threshold for chunk boundaries (0.0-1.0) Lower = more chunks, Higher = fewer chunks
overlap: usizeOverlap between chunks in characters
fallback_to_sentences: boolUse sentence boundaries as fallback when similarity is ambiguous
Implementations§
Source§impl SemanticChunkConfig
impl SemanticChunkConfig
Sourcepub fn long_document() -> SemanticChunkConfig
pub fn long_document() -> SemanticChunkConfig
Create config optimized for long documents.
Sourcepub fn coreference() -> SemanticChunkConfig
pub fn coreference() -> SemanticChunkConfig
Create config for coreference resolution (smaller chunks, higher similarity).
Trait Implementations§
Source§impl Clone for SemanticChunkConfig
impl Clone for SemanticChunkConfig
Source§fn clone(&self) -> SemanticChunkConfig
fn clone(&self) -> SemanticChunkConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for SemanticChunkConfig
impl Debug for SemanticChunkConfig
Source§impl Default for SemanticChunkConfig
impl Default for SemanticChunkConfig
Source§fn default() -> SemanticChunkConfig
fn default() -> SemanticChunkConfig
Returns the “default value” for a type. Read more
Auto Trait Implementations§
impl Freeze for SemanticChunkConfig
impl RefUnwindSafe for SemanticChunkConfig
impl Send for SemanticChunkConfig
impl Sync for SemanticChunkConfig
impl Unpin for SemanticChunkConfig
impl UnsafeUnpin for SemanticChunkConfig
impl UnwindSafe for SemanticChunkConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more