Struct TermToken 

pub struct TermToken {
    pub token_id: TokenID,
    pub value: Value,
    pub span: Option<Span>,
    pub op_tab_index: Option<usize>,
}

A token produced by the [TermLexer] for Prolog-like term parsing.

Each TermToken encapsulates:

• the syntactic token kind (token_id),
• an associated semantic Value,
• the line number on which it was recognized, and
• an optional operator-table index used for precedence/associativity lookup.

Fields

token_id: TokenID

value: Value

The associated value (if any).

span: Option<Span>

The line number where the token was recognized.

op_tab_index: Option<usize>

Optional operator definition index.

Implementations

impl TermToken

pub fn new(token_id: TokenID, value: Value, span: Option<Span>) -> Self

Creates a new TermToken with the specified token ID, value, and line number.

Parameters

• token_id: Token identifier from the lexer’s token table.
• value: Optional value attached to the token.
• line_no: Source line number where this token was found.

The op_tab_index field is initialized to None by default.

impl TermToken

pub fn merge_span(&mut self, other_token: &TermToken)

Trait Implementations

impl Clone for TermToken

fn clone(&self) -> TermToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TermToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Token for TermToken

Implements the Token trait for TermToken, allowing integration with the parlex core library.

type TokenID = TokenID

The type used to represent token identifiers.

fn token_id(&self) -> Self::TokenID

Returns the identifier of this token.

fn span(&self) -> Option<Span>

Returns the span of the token.