Struct FixedChunker 

pub struct FixedChunker { /* private fields */ }

Fixed-size chunker with configurable overlap.

Example

use slabs::{Chunker, FixedChunker};

let chunker = FixedChunker::new(100, 20);
let text = "A".repeat(250);
let slabs = chunker.chunk(&text);

// 250 bytes with step=80: starts at 0, 80, 160 = 3 chunks
// (240 would start a 4th but 240+100 > 250, and remainder < step)
assert!(slabs.len() >= 3);
assert_eq!(slabs[0].len(), 100);
assert_eq!(slabs[1].start, 80); // 100 - 20 overlap

Implementations

impl FixedChunker

pub fn new(size: usize, overlap: usize) -> Self

Create a new fixed-size chunker.

Arguments

• size - Maximum chunk size in bytes
• overlap - Bytes to overlap between adjacent chunks

Panics

Panics if size == 0 or overlap >= size.

pub fn no_overlap(size: usize) -> Self

Create a chunker with no overlap.

Trait Implementations

impl Chunker for FixedChunker

fn chunk_bytes(&self, text: &str) -> Vec<Slab>

Core chunking implementation returning slabs with byte offsets only.

fn estimate_chunks(&self, text_len: usize) -> usize

Estimate the number of chunks for a given text length.

fn chunk(&self, text: &str) -> Vec<Slab>

Split text into chunks with both byte and character offsets.

impl Clone for FixedChunker

fn clone(&self) -> FixedChunker

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FixedChunker

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.