Skip to main content

Token

fhp_tokenizer::token

Enum Token

pub enum Token<'a> {
    OpenTag {
        tag: Tag,
        name: Cow<'a, str>,
        attributes: Vec<Attribute<'a>>,
        self_closing: bool,
    },
    CloseTag {
        tag: Tag,
        name: Cow<'a, str>,
    },
    Text {
        content: Cow<'a, str>,
    },
    Comment {
        content: Cow<'a, str>,
    },
    Doctype {
        content: Cow<'a, str>,
    },
    CData {
        content: Cow<'a, str>,
    },
}

Expand description

A single token produced by the tokenizer.

All string payloads borrow from the original input ('a lifetime), except entity-decoded values which use Cow::Owned.

Variants§

OpenTag

An opening tag, e.g. <div class="foo">.

Fields

§tag: Tag

Interned tag name.

§name: Cow<'a, str>

Raw tag name slice from the input.

§attributes: Vec<Attribute<'a>>

Attribute list (may be empty).

§self_closing: bool

Whether the tag is self-closing (<br/>).

CloseTag

A closing tag, e.g. </div>.

Fields

§tag: Tag

Interned tag name.

§name: Cow<'a, str>

Raw tag name slice from the input.

Text

Text content between tags.

Fields

§content: Cow<'a, str>

The text content, entity-decoded if needed.

Comment

An HTML comment, e.g. .

Fields

§content: Cow<'a, str>

The comment body (without ).

Doctype

A DOCTYPE declaration, e.g. <!DOCTYPE html>.

Fields

§content: Cow<'a, str>

The content after DOCTYPE.

CData

A CDATA section, e.g. <![CDATA[...]]>.

Fields

§content: Cow<'a, str>

The CDATA content (without <![CDATA[ and ]]>).

Trait Implementations§

impl<'a> Clone for Token<'a>

fn clone(&self) -> Token<'a>

Returns a duplicate of the value. Read more

1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more

impl<'a> Debug for Token<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

impl<'a> PartialEq for Token<'a>

fn eq(&self, other: &Token<'a>) -> bool

Tests for self and other values to be equal, and is used by ==.

1.0.0 · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<'a> StructuralPartialEq for Token<'a>

Auto Trait Implementations§

impl<'a> Freeze for Token<'a>

impl<'a> RefUnwindSafe for Token<'a>

impl<'a> Send for Token<'a>

impl<'a> Sync for Token<'a>

impl<'a> Unpin for Token<'a>

impl<'a> UnsafeUnpin for Token<'a>

impl<'a> UnwindSafe for Token<'a>

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> CloneToUninit for T
where T: Clone,

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)

Performs copy-assignment from self to dest. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T> ToOwned for T
where T: Clone,

type Owned = T

The resulting type after obtaining ownership.

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.