Struct Lexer 

pub struct Lexer<'a> { /* private fields */ }

Source-backed lexer for shell scripts.

The public lexer surface is intended for lower-level tooling and benchmarks. It tokenizes using the default bash profile; use the parser constructors when dialect or zsh option state matters.

Implementations

impl<'a> Lexer<'a>

pub fn new(input: &'a str) -> Self

Create a new bash-profile lexer for the given input.

pub fn next_token_kind(&mut self) -> Option<TokenKind>

Get the next token kind from the input.

This skips whitespace and line comments, matching Lexer::next_lexed_token. It is useful for callers that only need the token stream shape.

pub fn next_lexed_token(&mut self) -> Option<LexedToken<'a>>

Get the next source-backed token from the input, skipping line comments.

Returned tokens expose their TokenKind and source Span. Comments are omitted from this public stream; the parser uses an internal variant when it needs to preserve them for AST attachment.

Trait Implementations

impl<'a> Clone for Lexer<'a>

fn clone(&self) -> Lexer<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.