Struct TokenizerCompatibilityProof 

pub struct TokenizerCompatibilityProof { /* private fields */ }

Proof that a target and external assistant use the same token-id vocabulary mapping.

The fingerprint is exposed only after both portable tokenizer identities have been compared. Backend factories consume this proof instead of deciding tokenizer compatibility themselves.

Implementations

impl TokenizerCompatibilityProof

pub fn prove( target_fingerprint: [u8; 32], assistant_fingerprint: [u8; 32], ) -> Result<Self, TokenizerCompatibilityError>

Establishes compatibility from independently reconstructed tokenizer identities.

pub const fn fingerprint(self) -> [u8; 32]

Returns the shared token-id vocabulary fingerprint established by this proof.

pub fn validate_target( self, target_fingerprint: [u8; 32], ) -> Result<(), TokenizerCompatibilityError>

Verifies that this proof is being applied to the target it was established for.

Trait Implementations

impl Clone for TokenizerCompatibilityProof

fn clone(&self) -> TokenizerCompatibilityProof

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TokenizerCompatibilityProof

impl Debug for TokenizerCompatibilityProof

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for TokenizerCompatibilityProof

impl PartialEq for TokenizerCompatibilityProof

fn eq(&self, other: &TokenizerCompatibilityProof) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TokenizerCompatibilityProof