Expand description
Token vocabulary for TØR-G IR.
This module defines the closed, finite set of tokens that comprise the TØR-G intermediate representation. LLMs emit these tokens directly, with no text parsing required.
Token vocabulary for TØR-G IR.
This module defines the closed, finite set of tokens that comprise the TØR-G intermediate representation. LLMs emit these tokens directly, with no text parsing required.