pub struct VarIntCompactor<W: Semiring> { /* private fields */ }Expand description
Variable-length integer compactor for diverse value ranges
VarIntCompactor uses variable-length encoding (similar to protobuf varints)
to efficiently encode integers that vary widely in magnitude. Small values
use fewer bytes while large values expand as needed.
§Compression Approach
- Small values (< 128) use 1 byte
- Medium values (< 16384) use 2 bytes
- Larger values use 3-5 bytes as needed
- Effective for FSTs with mixed small/large values
§Best Use Cases
- FSTs with mostly small labels/states but occasional large values
- Sparse FSTs where most values are near zero
- General-purpose compression when value distribution is unknown
Trait Implementations§
Source§impl<W: Clone + Semiring> Clone for VarIntCompactor<W>
impl<W: Clone + Semiring> Clone for VarIntCompactor<W>
Source§fn clone(&self) -> VarIntCompactor<W>
fn clone(&self) -> VarIntCompactor<W>
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl<W: Semiring> Compactor<W> for VarIntCompactor<W>
impl<W: Semiring> Compactor<W> for VarIntCompactor<W>
Source§type Element = VarIntElement<W>
type Element = VarIntElement<W>
Compressed element type that stores arc or weight data Read more
Source§fn compact(&self, arc: &Arc<W>) -> Self::Element
fn compact(&self, arc: &Arc<W>) -> Self::Element
Compress an arc into the compact element format Read more
Source§fn expand(&self, element: &Self::Element) -> Arc<W>
fn expand(&self, element: &Self::Element) -> Arc<W>
Expand a compressed element back into a full arc Read more
Source§fn compact_weight(&self, weight: &W) -> Self::Element
fn compact_weight(&self, weight: &W) -> Self::Element
Compress a semiring weight into the compact element format Read more
Source§fn expand_weight(&self, element: &Self::Element) -> W
fn expand_weight(&self, element: &Self::Element) -> W
Expand a compressed element back into a semiring weight Read more
Auto Trait Implementations§
impl<W> Freeze for VarIntCompactor<W>
impl<W> RefUnwindSafe for VarIntCompactor<W>where
W: RefUnwindSafe,
impl<W> Send for VarIntCompactor<W>
impl<W> Sync for VarIntCompactor<W>
impl<W> Unpin for VarIntCompactor<W>where
W: Unpin,
impl<W> UnsafeUnpin for VarIntCompactor<W>
impl<W> UnwindSafe for VarIntCompactor<W>where
W: UnwindSafe,
Blanket Implementations§
Source§impl<T> ArchivePointee for T
impl<T> ArchivePointee for T
Source§type ArchivedMetadata = ()
type ArchivedMetadata = ()
The archived version of the pointer metadata for this type.
Source§fn pointer_metadata(
_: &<T as ArchivePointee>::ArchivedMetadata,
) -> <T as Pointee>::Metadata
fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata
Converts some archived metadata to the pointer metadata for itself.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> LayoutRaw for T
impl<T> LayoutRaw for T
Source§fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>
fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>
Returns the layout of the type.
Source§impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
Source§unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool
unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool
Returns whether the given value has been niched. Read more
Source§fn resolve_niched(out: Place<NichedOption<T, N1>>)
fn resolve_niched(out: Place<NichedOption<T, N1>>)
Writes data to
out indicating that a T is niched.