Type Alias PythonToken 

pub type PythonToken = Token<PythonTokenType>;

Type alias for Python tokens.

Aliased Type

pub struct PythonToken {
    pub kind: PythonTokenType,
    pub span: Range<usize>,
}

Fields

kind: PythonTokenType

The kind/category of this kind (e.g., keyword, identifier, number)

span: Range<usize>

The byte range in the source text that this kind occupies