Skip to main content

compact

Function compact 

Source
pub async fn compact(
    dataset: &mut Dataset,
    options: &CompactOptions,
) -> Result<CompactionStats>
Expand description

Merge small fragments, split large fragments and remove deleted rows. Keeps the row order.

The plan uses the size of each fragment on disk. Each run of neighboring fragments that need work becomes fragments of about the same size, near the target. A row is never split, so a row larger than the target is a fragment on its own. lance-nd holds about one new fragment in memory at a time. Without work to do, the table keeps its version.