Struct TokenDomain 

pub struct TokenDomain { /* private fields */ }

Portable cardinality of one zero-based token-id domain.

Backends validate native token tensors without copying their values to the host. Architectures select the exact domain for each prediction boundary.

Implementations

impl TokenDomain

pub const fn new(cardinality: usize) -> Self

Creates the token IDs 0..cardinality.

pub const fn cardinality(self) -> usize

Number of valid zero-based token IDs.

Trait Implementations

impl Clone for TokenDomain

fn clone(&self) -> TokenDomain

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TokenDomain

impl Debug for TokenDomain

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for TokenDomain

impl PartialEq for TokenDomain

fn eq(&self, other: &TokenDomain) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TokenDomain