Struct Token

pub struct Token { /* private fields */ }

A token is a single unit of a command, such as a word, number or symbol. This is used to convert single characters in a more machine-readable format. For example, the string “ls -l” would be converted to a list of tokens like so: [“ls”, “-l”].

The token kind is a simple enum, which is used to distinguish between the different types of tokens. The token value is a string, which contains the actual value of the token. The token position is a simple integer, which contains the position of the token in the input string. This is used for error reporting.

Implementations

impl Token

pub fn get_kind(&self) -> &TokenKind

pub fn get_value(&self) -> &String

pub fn unknown(c: &char) -> Token

Trait Implementations

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.