Skip to main content

SeqVecFromIterBuilder

Struct SeqVecFromIterBuilder 

Source
pub struct SeqVecFromIterBuilder<T: Storable, E: Endianness, I> { /* private fields */ }
Expand description

A builder for creating a SeqVec from an iterator of sequences.

This builder is designed for constructing a SeqVec from a data source that produces sequences on the fly. It consumes the iterator in a single pass, compressing sequences as they arrive.

§Limitations

This builder does not support:

  • Codec::Auto: Automatic codec selection requires analyzing all data, which is impossible in a single pass.
  • Parameter estimation for codecs like Rice { log2_b: None } or Zeta { k: None }.

The codec must be fully specified. If an unsupported codec is provided, the build method will return an error.

§Examples

use compressed_intvec::seq::{SeqVec, LESeqVec, Codec};

// Generate sequences on the fly
let sequences_iter = (0..100).map(|i| vec![i as u32, i as u32 + 1]);

let vec: LESeqVec<u32> = SeqVec::from_iter_builder(sequences_iter)
    .codec(Codec::Gamma) // Must be specified
    .build()?;

assert_eq!(vec.num_sequences(), 100);

Implementations§

Source§

impl<T, E, I, S> SeqVecFromIterBuilder<T, E, I>
where T: Storable, E: Endianness, I: IntoIterator<Item = S>, S: AsRef<[T]>,

Source

pub fn new(iter: I) -> Self

Creates a new builder from an iterator with default settings.

The default codec is Codec::Gamma, as automatic selection is not possible in single-pass construction.

Source

pub fn codec(self, codec_spec: Codec) -> Self

Sets the compression codec to use.

The codec must be fully specified (no Auto, no None parameters).

§Arguments
  • codec_spec - The fully-specified codec to use for encoding.
§Errors

The build method will return an error if a codec requiring data analysis is provided.

Source

pub fn store_lengths(self, store: bool) -> Self

Enables or disables storing explicit sequence lengths.

When enabled, the builder stores a compact FixedVec of per-sequence lengths. This allows O(1) length queries and enables faster decoding paths that avoid end-bit checks.

The default is false to minimize memory usage.

Source

pub fn build(self) -> Result<SeqVec<T, E, Vec<u64>>, SeqVecError>
where T: 'static, BufBitWriter<E, MemWordWriterVec<u64, Vec<u64>>>: BitWrite<E, Error = Infallible> + CodesWrite<E>,

Builds the SeqVec by consuming the iterator.

This method streams sequences directly from the iterator without materializing them all in memory. Single-pass construction avoids temporary allocations but requires the codec to be fully specified.

§Errors

Returns a SeqVecError if:

  • An automatic or parameter-estimating codec spec is used.
  • An I/O error occurs during encoding.
§Examples
use compressed_intvec::seq::{SeqVec, LESeqVec, Codec};

let sequences: Vec<Vec<u32>> = vec![vec![1, 2], vec![3, 4, 5]];

let vec: LESeqVec<u32> = SeqVec::from_iter_builder(sequences.into_iter())
    .codec(Codec::Delta)
    .build()?;

Trait Implementations§

Source§

impl<T: Debug + Storable, E: Debug + Endianness, I: Debug> Debug for SeqVecFromIterBuilder<T, E, I>

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

§

impl<T, E, I> Freeze for SeqVecFromIterBuilder<T, E, I>
where I: Freeze,

§

impl<T, E, I> RefUnwindSafe for SeqVecFromIterBuilder<T, E, I>

§

impl<T, E, I> Send for SeqVecFromIterBuilder<T, E, I>
where I: Send, T: Send,

§

impl<T, E, I> Sync for SeqVecFromIterBuilder<T, E, I>
where I: Sync, T: Sync,

§

impl<T, E, I> Unpin for SeqVecFromIterBuilder<T, E, I>
where I: Unpin, T: Unpin, E: Unpin,

§

impl<T, E, I> UnsafeUnpin for SeqVecFromIterBuilder<T, E, I>
where I: UnsafeUnpin,

§

impl<T, E, I> UnwindSafe for SeqVecFromIterBuilder<T, E, I>
where I: UnwindSafe, T: UnwindSafe, E: UnwindSafe,

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CastableFrom<T> for T

Source§

fn cast_from(value: T) -> T

Call Self as W
Source§

impl<T, U> CastableInto<U> for T
where U: CastableFrom<T>,

Source§

fn cast(self) -> U

Call W::cast_from(self)
Source§

impl<T> DowncastableFrom<T> for T

Source§

fn downcast_from(value: T) -> T

Truncate the current UnsignedInt to a possibly smaller size
Source§

impl<T, U> DowncastableInto<U> for T
where U: DowncastableFrom<T>,

Source§

fn downcast(self) -> U

Call W::downcast_from(self)
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Splat<T> for T

Source§

fn splat(value: T) -> T

Source§

impl<T> To<T> for T

Source§

fn to(self) -> T

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> UpcastableFrom<T> for T

Source§

fn upcast_from(value: T) -> T

Extend the current UnsignedInt to a possibly bigger size.
Source§

impl<T, U> UpcastableInto<U> for T
where U: UpcastableFrom<T>,

Source§

fn upcast(self) -> U

Call W::upcast_from(self)