Enum syzlang_parser::token::Token

pub enum Token {
    Include,
    Incdir,
    Resource,
    Type,
    Define,
    Meta,
    CrocOpen,
    CrocClose,
    ParenOpen,
    ParenClose,
    BracketOpen,
    BracketClose,
    SquareOpen,
    SquareClose,
    Colon,
    Comma,
    Newline,
    Equal,
    Dollar,
    Comment(String),
    String(String),
    Name(String),
    Char(char),
}

All the different tokens we divide the language into

Variants

Include

Include a C header file

Incdir

Includes a directory of C header files

Resource

Resource keyword indicating a resource is being declared

Type

Type keyword, indicating a type being declared

Define

Define statement indicating a C macro expression is coming next

Meta

Meta keyword, next entry can be some meta information about the file

CrocOpen

Char: <

CrocClose

Char: >

ParenOpen

Char: (

ParenClose

Char: )

BracketOpen

Char: }

BracketClose

Char: }

SquareOpen

Char: [

SquareClose

Char: ]

Colon

Char: :

Comma

Char: ,

Newline

Equal

Char: =

Dollar

Char: $

Comment(String)

The text has been processed as a comment, because it started with ‘#’

String(String)

Some string enclosed in double quotes

Name(String)

Some identifier we didn’t match to any keyword

Char(char)

Character enclosed in single quotes

Implementations

impl Token

pub fn from_file(s: &Path) -> Result<Vec<Token>, Error>

Load all tokens from file

pub fn all_globs(dir: &Path, pattern: &str) -> Result<Vec<Vec<Token>>, Error>

Load all files matching glob pattern

pub fn create_from_str(data: &str) -> Result<Vec<Token>, Error>

Load all data from string

pub fn to_name(&self) -> Result<&String, Error>

Get token as string, but only it it’s a valid name identifier

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Token

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Hash for Token

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for Token

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl TryFrom<&Token> for Value

type Error = Error

The type returned in the event of a conversion error.

fn try_from(value: &Token) -> Result<Self, Self::Error>

Performs the conversion.

impl TryFrom<Token> for Value

type Error = Error

The type returned in the event of a conversion error.

fn try_from(value: Token) -> Result<Self, Self::Error>

Performs the conversion.

impl Eq for Token

impl StructuralPartialEq for Token