Struct scrappy_do::Spider

pub struct Spider { /* fields omitted */ }

Creates webs to be used to asynchronously and concurrently crawl a webpage. Internal state is lightweight so it is unecessary to wrap in Arc or Rc. Multithreading can be achieved by using the multithreaded tokio runtime.

Implementations

impl Spider

pub fn new(client: Client) -> Self

Create a new Spider to generate Webs.

Arguments

• client - The client used to make requests.

pub fn web<H, I, C>(&self) -> WebBuilder<H, C> where
    H: Handler<I, C> + 'static,
    I: Debug + Send + Unpin + 'static,
    C: Debug + Send + Unpin + 'static, 

Create a new WebBuilder.

Trait Implementations

impl Clone for Spider

fn clone(&self) -> Spider

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.