Struct SwapVecConfig 

pub struct SwapVecConfig {
    pub swap_after: usize,
    pub batch_size: usize,
    pub compression: Option<Compression>,
}

Configure when and how the vector should swap.

The file creation will happen after max(swap_after, batch_size) elements.

Keep in mind, that if the temporary file exists, after ever batch_size elements, at least one write (syscall) will happen.

Fields

swap_after: usize

The vector will create a temporary file and starting to swap after so many elements. If your elements have a certain size in bytes, you can multiply this value to calculate the required storage.

If you want to start swapping with the first batch, set to batch_size or smaller.

Default: 32 * 1024 * 1024

batch_size: usize

How many elements at once should be written to disk.
Keep in mind, that for every batch one hash (u64) and one bytecount (usize) will be kept in memory.

One batch write will result in at least one syscall.

Default: 32 * 1024

compression: Option<Compression>

If and how you want to compress your temporary file.
This might be only useful for data which is compressable, like timeseries often are.

Default: No compression

Trait Implementations

impl Debug for SwapVecConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SwapVecConfig

fn default() -> Self

Returns the “default value” for a type.