Expand description
§indexflow-sitemap
A high-performance, fault-tolerant, Google-compliant Sitemap parser and crawler in Rust.
§Features
- Standard XML (
<urlset>,<sitemapindex>) - Google extensions (Images, Videos, News, and XHTML Hreflang)
- Plain text (
.txt) sitemap support - Transparent Gzip decompression (
.xml.gz) with decompression-bomb caps - Circular reference detection and depth protection
Re-exports§
pub use compression::decode_if_gzipped;pub use compression::decode_if_gzipped_with_limit;pub use error::SitemapError;pub use parser::parse_datetime;pub use parser::parse_priority;pub use parser::parse_sitemap;pub use fetcher::SitemapFetcher;pub use models::*;
Modules§
- compression
- Transparent encoding sniff + gzip inflate with a hard uncompressed cap.
- error
- fetcher
- Async sitemap download + recursive index expansion.
- models
- parser