pub struct ProcessorConfig {
pub chunk_size: usize,
pub parallel_threshold: usize,
pub max_threads: Option<usize>,
pub overlap_size: usize,
}Expand description
Configuration options for text processing
Fields§
§chunk_size: usizeTarget size for each chunk in bytes
parallel_threshold: usizeMinimum text size to trigger parallel processing
max_threads: Option<usize>Maximum number of threads to use (None = use all available)
overlap_size: usizeSize of overlap between chunks for cross-boundary detection
Implementations§
Source§impl ProcessorConfig
impl ProcessorConfig
Sourcepub fn builder() -> ProcessorConfigBuilder
pub fn builder() -> ProcessorConfigBuilder
Creates a new builder for ProcessorConfig
Sourcepub fn small_text() -> Self
pub fn small_text() -> Self
Creates a configuration optimized for small texts
Sourcepub fn large_text() -> Self
pub fn large_text() -> Self
Creates a configuration optimized for large texts
Sourcepub fn validate(&self) -> Result<(), ProcessingError>
pub fn validate(&self) -> Result<(), ProcessingError>
Validates the configuration
Trait Implementations§
Source§impl Clone for ProcessorConfig
impl Clone for ProcessorConfig
Source§fn clone(&self) -> ProcessorConfig
fn clone(&self) -> ProcessorConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ProcessorConfig
impl Debug for ProcessorConfig
Auto Trait Implementations§
impl Freeze for ProcessorConfig
impl RefUnwindSafe for ProcessorConfig
impl Send for ProcessorConfig
impl Sync for ProcessorConfig
impl Unpin for ProcessorConfig
impl UnwindSafe for ProcessorConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more