Struct Tokenizer

pub struct Tokenizer;

Implementations

impl Tokenizer

pub fn parse(input: &str, p: Parser) -> Result<Parser, ParseTomlError>

Returns a wrapper around a rowan::GreenNodeBuilder called Parser. The can be turned into a walk-able SyntaxNode.

Examples

let toml = "";
let parse_builder = Parser::new();
let parsed = Tokenizer::parse(toml, parse_builder).expect("parse failed");
let green_node = parsed.parse().expect("parse failed");
let root_node = green_node.syntax();