spider-html5ever 0.40.0

High-performance browser-grade HTML5 parser (Send-able fork via spider-tendril)
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47

# spider-html5ever

A `Send`-friendly fork of [`html5ever`](https://github.com/servo/html5ever) for high-concurrency HTML parsing.

[![crates.io](https://img.shields.io/crates/v/spider-html5ever.svg)](https://crates.io/crates/spider-html5ever)

## Why this fork?

Upstream `html5ever`'s `Tokenizer`, `TreeBuilder`, and `Parser` are `!Send` because they hold `StrTendril` (and types containing it) internally. `StrTendril` is `!Send` in upstream `tendril` because its refcount is non-atomic. The transitive effect: no future holding an html5ever parser across an `.await` point can be `Send`, so the parser can't run on tokio's multi-threaded runtime via `tokio::spawn`.

This fork uses the following dependency stack:

- `tendril` → [`spider-tendril`](https://github.com/spider-rs/tendril) (atomic refcount default)
- `markup5ever` → [`spider-markup5ever`](https://github.com/spider-rs/markup5ever) (uses spider-tendril)

The html5ever source code itself is unchanged. The `Send`-ness propagates through the type system via the new tendril atomicity default.

Result:

- `Parser<Sink>: Send` for a `Send` sink whose handles are also `Send`.
- `Tokenizer` and `TreeBuilder` are `Send` with a compatible sink and handles. `BufferQueue` is `Send`.
- Async futures holding the parser across `.await` points are `Send`, enabling `tokio::spawn` on multi-threaded runtimes for true cooperative streaming HTML parsing.

Reference count changes use atomic operations. Parse behavior follows upstream.

## Use

```toml
[dependencies]
spider-html5ever = "0.40"
```

```rust
use html5ever::{parse_document, ...};
```

The library still imports as `html5ever`, so existing code requires no changes, only the dependency line in `Cargo.toml` needs to swap.

## License

Licensed under either of [Apache License, Version 2.0](LICENSE-APACHE) or [MIT license](LICENSE-MIT) at your option, matching the upstream `html5ever` license.

## Upstream sync

Vendored from servo/html5ever `a193ea7f2492d1e51eb32955a09c241345348dba` (0.40.0-dev). Requires Rust 1.85. `UPSTREAM.toml` records the source directory and fork delta.

Run `scripts/check-drift.sh` to list upstream commits since the pin. Run `scripts/sync-upstream.sh --to <ref>` from a clean tree to apply source changes and advance the pin. The sync preserves Cargo.toml, README.md, and the recorded exclusions; review dependencies and fork invariants before committing.