Module embedded_text::parser

source ·
Expand description

Parse text into smaller units Parse text into words, newlines and whitespace sequences

use embedded_text::parser::{Parser, Token};

let parser = Parser::parse("Hello, world!\n");
let tokens = parser.collect::<Vec<Token<'_>>>();

assert_eq!(vec![
    Token::Word("Hello,"),
    Token::Whitespace(1),
    Token::Word("world!"),
    Token::NewLine
], tokens);

Structs§

  • Parser
    Text parser. Turns a string into a stream of Token objects.

Enums§