pub struct FsstColumnEncoder {
pub table: FsstSymbolTable,
}Expand description
High-level encoder for a column of strings backed by an FsstSymbolTable.
Fields§
§table: FsstSymbolTableThe trained symbol table.
Implementations§
Source§impl FsstColumnEncoder
impl FsstColumnEncoder
Sourcepub fn train(strings: &[&str], sample_fraction: f64) -> IoResult<Self>
pub fn train(strings: &[&str], sample_fraction: f64) -> IoResult<Self>
Train an encoder on a sample of the provided strings.
sample_fraction controls what fraction of strings are used for
training (clamped to (0.0, 1.0]). Sampling is deterministic:
every floor(1 / sample_fraction)-th string is taken.
Sourcepub fn compress_column(&self, strings: &[&str]) -> Vec<Vec<u8>>
pub fn compress_column(&self, strings: &[&str]) -> Vec<Vec<u8>>
Compress all strings in the column.
Sourcepub fn decompress_column(&self, compressed: &[Vec<u8>]) -> IoResult<Vec<String>>
pub fn decompress_column(&self, compressed: &[Vec<u8>]) -> IoResult<Vec<String>>
Decompress a column of byte slices back to UTF-8 strings.
Returns an error if any decompressed byte sequence is not valid UTF-8.
Sourcepub fn column_compression_ratio(&self, strings: &[&str]) -> f64
pub fn column_compression_ratio(&self, strings: &[&str]) -> f64
Compute the average compression ratio over all strings.
Auto Trait Implementations§
impl Freeze for FsstColumnEncoder
impl RefUnwindSafe for FsstColumnEncoder
impl Send for FsstColumnEncoder
impl Sync for FsstColumnEncoder
impl Unpin for FsstColumnEncoder
impl UnsafeUnpin for FsstColumnEncoder
impl UnwindSafe for FsstColumnEncoder
Blanket Implementations§
impl<T> Allocation for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::RequestSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> Read<Exclusive, BecauseExclusive> for Twhere
T: ?Sized,
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.