peisar 0.2.0

A practical Markdown parser written in Rust
Documentation

NPM

Peisar parses CommonMark Markdown with GitHub Flavored Markdown (GFM), Kramdown block attributes, YAML front matter, source spans, AST visitors, and custom parser hooks. The static-site tooling built on Peisar now lives in the separate peisar-ssg package.

Features

  • CommonMark blocks and inlines, including HTML and reference links
  • GFM tables, strikethrough, task lists, and autolinks
  • Kramdown block attributes such as {:#intro .lead key="value"}
  • YAML front matter, returned separately from rendered Markdown
  • Source spans on every AST node
  • AST visitors and during-parse extension hooks
  • A native N-API Node.js addon with generated TypeScript declarations
  • A Rust library (rlib) with public module paths for the parser, renderer, and high-level document APIs

Node.js

Install the package:

npm install peisar

Create a Peisar document, then read its AST, rendered HTML, front matter, or serialized AST:

const { Peisar } = require("peisar");

const document = new Peisar("# Hello **world**", { fragment: true });

console.log(document.html); // <h1>Hello <strong>world</strong></h1>\n
console.log(document.ast); // { nodeType: "root", children: [...], ... }
console.log(document.astJson); // JSON string
console.log(document.frontmatter); // object, or null

ast and astJson serialize the same tree differently: ast (the real JavaScript object) uses PascalCase type values (Heading, Paragraph, Link) and a nodeType: "root" root, while astJson mirrors the Rust serialization with snake_case types (heading, paragraph, link) and a type: "root" root.

Options

All options are optional. GFM and Kramdown are enabled by default; html returns a complete document unless fragment is true.

const document = new Peisar("# Title", {
  gfm: false,
  kramdown: false,
  fileName: "guide.md",
  fragment: true,
  charset: true,
  viewport: true,
  title: "Guide",
  bodyClass: "docs",
  style: "h1 { color: rebeccapurple; }",
});

charset, viewport, title, bodyClass, and style affect full-document output only.

Front matter

Leading YAML front matter is removed before Markdown parsing and exposed as a JavaScript object:

const document = new Peisar(`---
title: Hello
tags:
  - docs
---

# Hello`, { fragment: true });

console.log(document.frontmatter); // { title: "Hello", tags: ["docs"] }
console.log(document.html); // <h1>Hello</h1>\n

AST visitors

Register visitors with useVisitor. Each callback receives a one-item tuple, may mutate the supplied node, and can return a control object. Return { recurse: true } to visit children; replacements are not visited again. An omitted return value keeps the node without recursing.

const document = new Peisar("# Hello", { fragment: true });

document.useVisitor({
  visitBlock([block]) {
    if (block.type === "Heading") {
      return { replaceWith: [{ ...block, level: 2 }] };
    }
    return { recurse: true };
  },
});

console.log(document.html); // <h2>Hello</h2>\n

The control fields are insertBefore, insertAfter, replaceWith, remove, and recurse. The same shape applies to visitInline.

Custom parser hooks

Use useParser for syntax that must be recognized while parsing. Block hooks receive { line, lineIndex, lines }; inline hooks receive { rest, index }. Hooks run before built-in matchers, in registration order. Return undefined to decline a position.

const document = new Peisar("See [[Some Page]].", { fragment: true });
const zero = { line: 0, column: 0, offset: 0 };

document.useParser({
  parseInline([{ rest }]) {
    if (!rest.startsWith("[[")) return;
    const close = rest.indexOf("]]");
    if (close === -1) return;
    const target = rest.slice(2, close);
    return {
      inline: {
        type: "Link",
        text: [{ type: "Text", value: target, pos: { start: zero, end: zero } }],
        url: `/wiki/${target.replaceAll(" ", "_")}`,
        autolink: false,
        pos: { start: zero, end: zero },
      },
      consumed: close + 2,
    };
  },
});

console.log(document.html); // <p>See <a href="/wiki/Some_Page">Some Page</a>.</p>\n

parseBlock must consume at least one line. parseInline must consume at least one character; a missing or zero consumed value declines the result. Peisar recomputes the source span of a hook-returned node, so a complete placeholder pos is sufficient.

Rust

Add the crate to a Rust project:

[dependencies]
peisar = "0.2.0"

The public Rust API is module-based. Import the parser from peisar::markdown::ast, the renderer from peisar::markdown::html, and the high-level document wrapper from peisar::markdown::peisar.

Parse and render

use peisar::markdown::ast::{AstOptions, Document};
use peisar::markdown::ast::tokens::token::Block;
use peisar::markdown::html::{RenderOptions, render_document_html};

let document = Document::parse("# Hello **world**\n", &AstOptions::default(), None);
assert!(matches!(document.children[0], Block::Heading { level: 1, .. }));

let html = render_document_html(
    &document,
    Some(RenderOptions {
        fragment: true,
        ..Default::default()
    }),
);
assert_eq!(html, "<h1>Hello <strong>world</strong></h1>\n");

For the Node-like parse-and-render wrapper:

use peisar::markdown::config::PeisarOptions;
use peisar::markdown::peisar::Peisar;

let mut document = Peisar::new(
    "# Hello".into(),
    Some(PeisarOptions {
        fragment: Some(true),
        ..Default::default()
    }),
);
assert_eq!(document.html(), "<h1>Hello</h1>\n");

Front matter and visitors

use peisar::frontmatter::parse_markdown_frontmatter;

let parsed = parse_markdown_frontmatter("---\ntitle: Hello\n---\n\n# Hello")?;
assert_eq!(parsed.yaml_data().unwrap()["title"], "Hello");
assert_eq!(parsed.pure_markdown_content(), "# Hello");

parse_markdown_frontmatter returns a ParseResult with yaml_data(), pure_markdown_content(), and into_parts(). A front-matter block must open with --- on the first non-whitespace line and close with a line starting ---; an unterminated block is treated as ordinary Markdown body.

For post-parse traversal, implement peisar::markdown::ast::AstVisitor and call peisar::markdown::ast::visitor::visit_document_mut. The visitor controls are VisitControl and InlineVisitControl from that same visitor module.

AstParser and ParseHooks are publicly exported from peisar::markdown::ast for integration with Peisar internals, but the hook-enabled parser entry point is not yet public to external Rust consumers. Use useParser from Node.js for registered custom syntax today.

Development

npm install
npm run build:local
npm test
cargo test

Run npm run build:local after changing N-API-annotated Rust code; it regenerates the package loader and TypeScript declarations before the Node.js tests run.

More detail in CONTRIBUTING

AI integration

Peisar supplies Agent Skills for AI coding tools:

npx skills add phothinmg/peisar
  • peisar-parse-markdown: consume the Node.js and Rust Markdown APIs
  • peisar-ast-visitors: make post-parse AST transformations
  • peisar-parser-hooks: add syntax recognized during parsing
  • peisar-development: modify and validate the codebase

Project structure

src/
├── frontmatter/             YAML front-matter parser
├── markdown/
│   ├── ast/                 AST nodes, parsers, visitors, and hooks
│   ├── config/              combined parser and renderer options
│   ├── html/                HTML renderer
│   └── peisar/              high-level N-API `Peisar` class
└── lib.rs                   public module declarations

LICENSE

Apache-2.0 © Pho Thin Maung

Security policy: SECURITY.md