Struct tongrams::EliasFanoTrieArray

pub struct EliasFanoTrieArray { /* private fields */ }

Spece-efficient implementation of TrieArray with Elias-Fano encording.

Trait Implementations

impl Default for EliasFanoTrieArray

fn default() -> EliasFanoTrieArray

Returns the “default value” for a type.

impl TrieArray for EliasFanoTrieArray

fn token_id(&self, i: usize) -> usize

Gets the token id with a given index.

fn find_token(&self, pos: usize, id: usize) -> Option<usize>

Searches for an element within a given range, returning its index. TODO: Make faster

fn build(token_ids: Vec<usize>, pointers: Vec<usize>) -> Box<Self>

Builds a TrieArray from sequences of token ids and pointers.

fn serialize_into<W>(&self, writer: W) -> Result<usize> where
    W: Write, 

Serializes the data structure into the writer.

fn deserialize_from<R>(reader: R) -> Result<Box<Self>> where
    R: Read, 

Deserializes the data structure from the reader.

fn size_in_bytes(&self) -> usize

Gets the number of bytes to serialize the data structure.

fn memory_statistics(&self) -> Value

Gets breakdowns of memory usages for components.

fn range(&self, pos: usize) -> (usize, usize)

Gets the range pointers[pos]..pointers[pos+1].

fn num_tokens(&self) -> usize

Gets the number of tokens stored.

fn num_pointers(&self) -> usize

Gets the number of pointers stored.