Struct Translator 

pub struct Translator {
    pub from_id: String,
    pub to_id: String,
    /* private fields */
}

Cross-vocab agent-handoff pipe.

Fields

from_id: String

to_id: String

Implementations

impl Translator

pub fn new(from_map: &TokenizerMap, to_map: &TokenizerMap) -> Self

Construct a translator from V_A (from_map) to V_B (to_map).

pub fn translate(&mut self, ids: &[u32], partial: bool) -> Vec<u32>

Translate a chunk of source-vocab IDs to target-vocab IDs.

partial=true for streaming chunks (a trailing partial word stays buffered). partial=false (or call Translator::finish) on the final chunk so the buffer drains.

pub fn finish(&mut self) -> Vec<u32>

End-of-stream flush. Equivalent to translate(&[], false).

pub fn reset(&mut self)

Drop all internal state. Call between conversations.