Struct PreparedText 

pub struct PreparedText {
    pub token_ids: Vec<u32>,
    pub normalization_trace: NormalizationTrace,
}

Token ids and a caller-owned trace returned by a model-specific text preparer.

Fields

token_ids: Vec<u32>

Token ids the model will consume.

normalization_trace: NormalizationTrace

Detailed normalization record, retained only in request-local memory.

Implementations

impl PreparedText

pub fn new(token_ids: Vec<u32>, normalization_trace: NormalizationTrace) -> Self

Constructs a prepared text payload from model-specific tokenization.

Trait Implementations

impl Clone for PreparedText

fn clone(&self) -> PreparedText

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PreparedText

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for PreparedText

impl PartialEq for PreparedText

fn eq(&self, other: &PreparedText) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for PreparedText