Struct Response 

pub struct Response {
    pub url: Url,
    pub status: StatusCode,
    pub headers: HeaderMap,
    pub body: Bytes,
    pub request_url: Url,
    pub meta: DashMap<Cow<'static, str>, Value>,
}

Represents an HTTP response received from a server.

Fields

url: Url

The final URL of the response after any redirects.

status: StatusCode

The HTTP status code of the response.

headers: HeaderMap

The headers of the response.

body: Bytes

The body of the response.

request_url: Url

The original URL of the request that led to this response.

meta: DashMap<Cow<'static, str>, Value>

Metadata associated with the response, carried over from the request.

Implementations

impl Response

pub fn request_from_response(&self) -> Request

Reconstructs the original Request that led to this response.

pub fn json<T: DeserializeOwned>(&self) -> Result<T, Error>

Deserializes the response body as JSON.

pub fn to_html(&self) -> Result<Html, Utf8Error>

Parses the response body as HTML.

Examples found in repository

examples/quotes_scraper.rs (line 38)

    async fn parse(&mut self, response: Response) -> Result<ParseOutput<Self::Item>, SpiderError> {
        let html = response.to_html()?;
        let mut output = ParseOutput::new();

        for quote_element in html.select(&".quote".to_selector()?) {
            let text = quote_element
                .select(&".text".to_selector()?)
                .next()
                .map(|e| e.text().collect::<String>().trim().to_string())
                .unwrap_or_default();

            let author = quote_element
                .select(&".author".to_selector()?)
                .next()
                .map(|e| e.text().collect::<String>().trim().to_string())
                .unwrap_or_default();

            let tags: Vec<String> = quote_element
                .select(&".tags .tag".to_selector()?)
                .map(|e| e.text().collect::<String>().trim().to_string())
                .collect();
            let tags_str = tags.join(", ");

            let item = QuoteItem {
                text,
                author,
                tags: tags_str,
            };
            output.add_item(item);
        }

        if let Some(next_href) = html
            .select(&".next > a".to_selector()?)
            .next()
            .and_then(|a| a.attr("href"))
        {
            let next_url = response.url.join(next_href)?;
            let next_request = Request::new(next_url);
            output.add_request(next_request);
        }

        Ok(output)
    }

pub fn links(&self) -> DashSet<Link>

Extracts all unique, same-site links from the response body.

Trait Implementations

impl Clone for Response

fn clone(&self) -> Response

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Response

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.