Module embedded_text::parser

Parse text into words, newlines and whitespace sequences.

use embedded_text::parser::{Parser, Token};

let parser = Parser::parse("Hello, world!\n");
let tokens = parser.collect::<Vec<Token<'_>>>();

assert_eq!(
    vec![
        Token::Word("Hello,"),
        Token::Whitespace(1),
        Token::Word("world!"),
        Token::NewLine
    ],
    tokens
);

Structs

Parser

Text parser. Turns a string into a stream of Token objects.

Enums

Token

A text token