Skip to main content

adaptive_chunk

Function adaptive_chunk 

Source
pub fn adaptive_chunk(
    content: &str,
    budget_tokens: usize,
    total_items: usize,
) -> Vec<ChunkResult>
Expand description

Split content into prioritized chunks sized to budget_tokens spread across total_items sibling slices.