Struct HereDocData 

pub struct HereDocData {
    pub content: String,
    pub source_body: String,
    pub delimiter: String,
    pub literal: bool,
    pub strip_tabs: bool,
    pub body_start_offset: usize,
}

Tokens produced by the kaish lexer.

The order of variants matters for logos priority. More specific patterns (like keywords) should come before more general ones (like identifiers).

Tokens that carry semantic values (strings, numbers, identifiers) include the parsed value directly. This ensures the parser has access to actual data, not just token types. Here-doc content data.

• literal is true when the delimiter was quoted (<<'EOF' or <<"EOF"), meaning no variable expansion should occur.
• strip_tabs is true for the <<-EOF form. Per POSIX, leading tabs on each body line are stripped at materialization time. Stripping happens downstream of the parser so byte offsets in content stay aligned with their original-source positions for span-tracking purposes.
• body_start_offset is the exact byte offset of the first character of content in the original source passed to tokenize. This lets the parser compute absolute spans for parts found inside the body during interpolation. (For interpolated bodies containing $((..)), spans of parts AFTER the rewritten expression drift by the rewrite’s length difference — the body-local ${__ARITH:expr__} form is longer than the source text; see rewrite_body_arithmetic.)
• delimiter is the word as written with its quotes removed (PY for both <<PY and <<'PY'), kept because it is the language hint the author chose and a plan publishes it.
• source_body is the body exactly as it appears in the source. It differs from content only for an interpolated body containing $((…)), which content carries in the rewritten ${__ARITH:…} form — a kernel-internal spelling that must never reach a plan.

Fields

content: String

source_body: String

delimiter: String

literal: bool

strip_tabs: bool

body_start_offset: usize

Trait Implementations

impl Clone for HereDocData

fn clone(&self) -> HereDocData

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for HereDocData

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for HereDocData

fn eq(&self, other: &HereDocData) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for HereDocData