pub struct LateChunkingConfig {
pub chunk_size: usize,
pub chunk_overlap: usize,
pub max_doc_tokens: u32,
pub annotate_positions: bool,
}Expand description
Configuration for the late chunking strategy
Fields§
§chunk_size: usizeTarget chunk size in characters
chunk_overlap: usizeChunk overlap in characters
max_doc_tokens: u32Maximum document size in tokens before splitting into sections.
8192for Jina v3 (default)32768for gte-Qwen2-7B-instruct
annotate_positions: boolAnnotate each chunk’s position_in_document metadata field.
Embedding providers can use this to apply position-aware pooling.
Trait Implementations§
Source§impl Clone for LateChunkingConfig
impl Clone for LateChunkingConfig
Source§fn clone(&self) -> LateChunkingConfig
fn clone(&self) -> LateChunkingConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for LateChunkingConfig
impl Debug for LateChunkingConfig
Source§impl Default for LateChunkingConfig
impl Default for LateChunkingConfig
Source§impl<'de> Deserialize<'de> for LateChunkingConfig
impl<'de> Deserialize<'de> for LateChunkingConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for LateChunkingConfig
impl RefUnwindSafe for LateChunkingConfig
impl Send for LateChunkingConfig
impl Sync for LateChunkingConfig
impl Unpin for LateChunkingConfig
impl UnsafeUnpin for LateChunkingConfig
impl UnwindSafe for LateChunkingConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more