Module html5ever::tokenizer

source ·
Expand description

The HTML5 tokenizer.

Re-exports

pub use self::interface::StartTag;
pub use self::interface::EndTag;
pub use self::interface::DoctypeToken;
pub use self::interface::TagToken;
pub use self::interface::CommentToken;
pub use self::interface::CharacterTokens;
pub use self::interface::NullCharacterToken;
pub use self::interface::EOFToken;
pub use self::interface::ParseError;
pub use buffer_queue::FromSet;
pub use buffer_queue::NotFromSet;

Modules

Tokenizer states.

Structs

A queue of owned string buffers, which supports incrementally consuming characters.
A DOCTYPE token.
A tag token.
The HTML tokenizer.
Tokenizer options, with an impl for Default.

Enums

Result from pop_except_from containing either a character from a SmallCharSet, or a string buffer of characters not from the set.

Traits

Types which can receive tokens from the tokenizer.