Skip to main content

scrape_with_readability

Function scrape_with_readability 

Source
pub async fn scrape_with_readability(
    client: &ClientWithMiddleware,
    url: &Url,
) -> Result<Vec<ScrapedContent>>
Expand description

Scrape a URL using Readability algorithm for clean content extraction

This is the 2026 best practice approach — uses the same algorithm as Firefox Reader View to extract only meaningful content.

§Examples

use rust_scraper::application::{create_http_client, scrape_with_readability};

let client = create_http_client()?;
let url = url::Url::parse("https://example.com")?;
let results = scrape_with_readability(&client, &url).await?;