Struct TermToken 

pub struct TermToken {
    pub token_id: TokenID,
    pub value: Value,
    pub line_no: usize,
    pub op_tab_index: Option<usize>,
}

A token produced by the TermLexer for Prolog-like term parsing.

Each TermToken encapsulates:

• the syntactic token kind (token_id),
• an associated semantic Value,
• the line number on which it was recognized, and
• an optional operator-table index used for precedence and associativity lookup.

Tokens are emitted by the lexer and consumed by the parser during syntax analysis.

Fields

token_id: TokenID

value: Value

The associated value (if any).

line_no: usize

The line number where the token was recognized.

op_tab_index: Option<usize>

Optional operator definition index.

Implementations

impl TermToken

pub fn new(token_id: TokenID, value: Value, line_no: usize) -> Self

Creates a new TermToken with the specified token ID, value, and line number.

Parameters

• token_id: Token identifier from the lexer’s token table.
• value: Optional value attached to the token.
• line_no: Source line number where this token was found.

The op_tab_index field is initialized to None by default.

Trait Implementations

impl Clone for TermToken

fn clone(&self) -> TermToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TermToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Token for TermToken

Implements the Token trait for TermToken, allowing integration with the parlex core library.

This provides access to token identifiers and source line tracking.

type TokenID = TokenID

The type used to represent token identifiers.

fn token_id(&self) -> Self::TokenID

Returns the identifier of this token.

fn line_no(&self) -> usize

Returns the line number where this token appears in the source.