Struct UrlScraper 

pub struct UrlScraper { /* private fields */ }

Stores the HTML document in memory.

Implementations

impl UrlScraper

pub fn new(url: &str) -> Result<Self, Error>

Constructs a new scraper from a given URL.

Examples found in repository

examples/example.rs (line 7)

fn main() {
    let directory = "http://phoronix.com/";

    let scraper = UrlScraper::new(directory).unwrap();
    for (text, url) in scraper.into_iter() {
        println!("{}: {}", text, url);
    }
}

pub fn new_with_client(url: &str, client: &Client) -> Result<Self, Error>

Use an existing reqwest::Client to make a request.

pub fn new_with_html(url: &str, html: &str) -> Result<Self, Error>

In case the HTML has already been fetched in advance, this can be used to parse from it directly.

pub fn into_iter<'a>(&'a self) -> UrlIter<'a, 'a>

Fetch the URLs using an iterator.

Examples found in repository

examples/example.rs (line 8)

fn main() {
    let directory = "http://phoronix.com/";

    let scraper = UrlScraper::new(directory).unwrap();
    for (text, url) in scraper.into_iter() {
        println!("{}: {}", text, url);
    }
}