pub struct GroupingConfig {
pub context_length_bucket: u32,
}Expand description
Configuration for the grouping algorithm.
Fields§
§context_length_bucket: u32Context length bucket size in tokens. Items whose token counts fall in the same bucket (token_count / bucket_size) are grouped together to minimize Ollama memory reallocation.
Trait Implementations§
Source§impl Clone for GroupingConfig
impl Clone for GroupingConfig
Source§fn clone(&self) -> GroupingConfig
fn clone(&self) -> GroupingConfig
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for GroupingConfig
impl Debug for GroupingConfig
Auto Trait Implementations§
impl Freeze for GroupingConfig
impl RefUnwindSafe for GroupingConfig
impl Send for GroupingConfig
impl Sync for GroupingConfig
impl Unpin for GroupingConfig
impl UnsafeUnpin for GroupingConfig
impl UnwindSafe for GroupingConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more