scrape-core

High-performance HTML parsing library core. Pure Rust implementation with no FFI dependencies.

Installation

[dependencies]
scrape-core = "0.2"

Or with cargo:

cargo add scrape-core

[!IMPORTANT] Requires Rust 1.88 or later.

Usage

use scrape_core::Soup;

let html = r#"
    <html>
        <body>
            <div class="content">Hello, World!</div>
            <div class="content">Another div</div>
        </body>
    </html>
"#;

let soup = Soup::new(html);

// Find first element by tag
if let Some(div) = soup.find("div") {
    println!("Text: {}", div.text());
}

// CSS selectors
for el in soup.select("div.content") {
    println!("{}", el.inner_html());
}

Features

Enable optional features in Cargo.toml:

[dependencies]
scrape-core = { version = "0.2", features = ["simd", "parallel"] }

Feature	Description	Default
`simd`	SIMD-accelerated byte scanning (SSE4.2, AVX2, NEON, WASM SIMD128)	No
`parallel`	Parallel batch processing via Rayon	No

[!TIP] Start with default features for fastest compile times. Add simd for production workloads.

Performance

v0.2.0 includes significant performance improvements:

SIMD-accelerated class selector matching — 2-10x faster on large documents with many class selectors
Selector fast-paths — Direct optimization for common patterns (tag-only, class-only, ID-only selectors)
Arena-based DOM allocation — Cache-friendly, zero per-node heap allocations
50-70% memory reduction — Zero-copy HTML serialization via Cow optimization
Parallel batch processing — Rayon-powered when parallel feature is enabled (near-linear scaling)

Benchmarks show 10x faster parsing and up to 132x faster queries compared to BeautifulSoup. See full benchmark results in the main project README.

Type Safety

v0.2.0 introduces compile-time safety via the typestate pattern:

Document lifecycle states — Building (construction) → Queryable (ready) → Sealed (immutable)
Sealed traits — Prevent unintended implementations while allowing future extensions
Zero runtime overhead — State encoding uses PhantomData with no allocation cost
Trait abstractions — HtmlSerializer trait and ElementFilter iterators for consistent DOM access

All safety guarantees are verified at compile time with zero performance impact.

Architecture

scrape-core/
├── dom/       # Arena-based DOM representation
├── parser/    # html5ever integration
├── query/     # CSS selector engine
├── simd/      # Platform-specific SIMD acceleration
└── parallel/  # Rayon-based parallelization

Built on Servo

The parsing and selector engine is powered by battle-tested libraries from the Servo browser engine:

html5ever — Spec-compliant HTML5 parser
selectors — CSS selector matching engine
cssparser — CSS parser
markup5ever — Common HTML/XML tree data structures

MSRV policy

Minimum Supported Rust Version: 1.88. MSRV increases are minor version bumps.

Related packages

This crate is part of fast-scrape:

Platform	Package
Python	`fast-scrape`
Node.js	`@fast-scrape/node`
WASM	`@fast-scrape/wasm`

License

Licensed under either of Apache License, Version 2.0 or MIT License at your option.

scrape-core 0.2.0