Struct scrappy_do::WebBuilder

pub struct WebBuilder<H, C> { /* fields omitted */ }

A WebBuilder can be used to create a Web with custom behavior.

Implementations

impl<H, C> WebBuilder<H, C> where
    C: Debug + Send + Unpin + 'static, 

pub fn start(self, start: Request) -> Self

Set the initial request to be processed.

pub fn handler(self, handler: H) -> Self

Set the Handler that processes the Response generated from the initial Request.

pub fn context(self, context: C) -> Self

Set the initial context.

pub fn concurrent_requests(self, concurrent_requests: NonZeroUsize) -> Self

Set the maximum allowed concurrent requests to be executed during a crawl.

pub fn task_queue_size_bytes(self, task_queue_size_bytes: NonZeroUsize) -> Self

Set the task queue size used during a crawl.

pub fn build<I>(self) -> Web<I, C> where
    I: Debug + Send + Unpin + 'static,
    H: Handler<I, C> + 'static, 

Build the Web.