Struct article_scraper::Readability

pub struct Readability;

Rust port of mozilla readability algorithm

Used as fallback for ArticleScraper if no fitting config can be found

Implementations

impl Readability

pub async fn extract( html: &str, base_url: Option<Url> ) -> Result<String, FullTextParserError>

Parse HTML and extract meaningful content

Arguments

• html - HTML of a website containing an article or similar content
• base_url - URL used to complete relative URLs

Examples

use url::Url;
use article_scraper::Readability;

async fn demo() {
    let html = reqwest::get("https://www.nytimes.com/interactive/2023/04/21/science/parrots-video-chat-facetime.html")
        .await
        .unwrap()
        .text()
        .await
        .unwrap();
    let base_url = Url::parse("https://www.nytimes.com").unwrap();
    let extracted_content = Readability::extract(&html, Some(base_url)).await.unwrap();
}