Struct regen::core::lang::Language

pub struct Language {
    pub context: Option<String>,
    pub target: String,
    pub tokens: Vec<TokenDef>,
    pub token_rules: Vec<TokenRule>,
    pub semantics: Vec<String>,
    pub rules: HashMap<String, Rule>,
    pub includes: Vec<String>,
}

Definition of a language

A language consists of:

• a set of tokens, defined with the token keyword
• a set of tokenizer rules, defined with TokenType "literal" or TokenType /regex/. The syntax of the regex depends on the target language
• a set of semantics, defined with the semantics keyword
• a set of derivations, defined with the rule keyword
• a context object, defined with the context keyword
• a list of include files in the output

Fields

context: Option<String>

The context type name.

If this is None, it will be set to the reasonable “None” in the target language. (For example, () in Rust

target: String

The target rule name

tokens: Vec<TokenDef>

The token definitions

token_rules: Vec<TokenRule>

The token rules

semantics: Vec<String>

The semantic definitions

rules: HashMap<String, Rule>

The rule definitions

includes: Vec<String>

The files to include (relative path from the grammar file)

Implementations

impl Language

pub fn dyn_tokenize(&self, src: &str) -> TokenizerOutput<DynTok>

Dynamically tokenize a source code string based on this language

Trait Implementations

impl ASTParser for Language

Generate a dynamic AST from a token stream based on this language

type T = String

Token type

type A = DynAstNode

AST root type

fn parse_ast(&self, ts: &mut TokenStream<'_, Self::T>) -> Option<Self::A>

Parse one AST root from the TokenStream

fn parse_ast_all(&self, ts: &mut TokenStream<'_, Self::T>) -> ASTResult<Self::A>

Create all ASTs from the source code, until the token stream is exhausted

impl Clone for Language

fn clone(&self) -> Language

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Language

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Language

fn default() -> Language

Returns the “default value” for a type.