Enum Lexeme 

pub enum Lexeme<'src> {
    Scalar {
        span: Span,
        value: Cow<'src, str>,
        kind: ScalarKind,
    },
    Unit {
        span: Span,
    },
    Tag {
        span: Span,
        name: &'src str,
        has_payload: bool,
    },
    ObjectStart {
        span: Span,
    },
    ObjectEnd {
        span: Span,
    },
    SeqStart {
        span: Span,
    },
    SeqEnd {
        span: Span,
    },
    AttrKey {
        span: Span,
        key_span: Span,
        key: &'src str,
    },
    Comma {
        span: Span,
    },
    Newline {
        span: Span,
    },
    Comment {
        span: Span,
        text: &'src str,
    },
    DocComment {
        span: Span,
        text: &'src str,
    },
    Eof,
    Error {
        span: Span,
        message: &'static str,
    },
}

A lexeme produced by the Lexer from raw tokens.

Variants

Scalar

A scalar value (bare, quoted, raw, or heredoc)

Fields

span: Span

value: Cow<'src, str>

kind: ScalarKind

Unit

Unit value: standalone @

Fields

span: Span

Tag

A tag: @name The payload (if any) comes as the next lexeme

Fields

span: Span

name: &'src str

has_payload: bool

True if an immediate payload follows (no whitespace): @tag{}, @tag(), @tag"x", @tag@

ObjectStart

Start of object {

Fields

span: Span

ObjectEnd

End of object }

Fields

span: Span

SeqStart

Start of sequence (

Fields

span: Span

SeqEnd

End of sequence )

Fields

span: Span

AttrKey

An attribute key key> - value follows as next lexeme(s)

Fields

span: Span

Span of the full key> including the >

key_span: Span

Span of just the key (excluding >)

key: &'src str

The key text

Comma

Comma separator

Fields

span: Span

Newline

Newline (significant for separator detection)

Fields

span: Span

Comment

Line comment // ...

Fields

span: Span

text: &'src str

DocComment

Doc comment /// ...

Fields

span: Span

text: &'src str

Eof

End of input

Error

Tokenizer error

Fields

span: Span

message: &'static str

Implementations

impl Lexeme<'_>

pub fn span(&self) -> Span

Get the span of this lexeme. Returns a zero-length span at position 0 for Eof.

Trait Implementations

impl<'src> Clone for Lexeme<'src>

fn clone(&self) -> Lexeme<'src>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'src> Debug for Lexeme<'src>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'src> PartialEq for Lexeme<'src>

fn eq(&self, other: &Lexeme<'src>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<'src> StructuralPartialEq for Lexeme<'src>