Struct NgramSegment 

pub struct NgramSegment {
    pub prefix: String,
    pub ngrams: HashMap<String, HashMap<String, u32>>,
    pub size_bytes: usize,
}

N-gram segment for paged storage.

Each segment contains n-grams for a specific context prefix, allowing on-demand loading.

Fields

prefix: String

Context prefix this segment covers (e.g., “git”, “cargo”)

ngrams: HashMap<String, HashMap<String, u32>>

N-gram data: context -> (next_token -> count)

size_bytes: usize

Size estimate in bytes

Implementations

impl NgramSegment

pub fn new(prefix: String) -> Self

Create a new empty segment.

pub fn add(&mut self, context: String, next_token: String, count: u32)

Add an n-gram to this segment.

pub fn to_bytes(&self) -> Vec<u8>

Serialize to bytes.

pub fn from_bytes(bytes: &[u8]) -> Result<Self>

Deserialize from bytes.

Trait Implementations

impl Clone for NgramSegment

fn clone(&self) -> NgramSegment

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for NgramSegment

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for NgramSegment

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for NgramSegment

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.