Struct CrawlConfig 

pub struct CrawlConfig {
    pub seed_url: Option<String>,
    pub max_depth: u16,
    pub global_concurrency: usize,
    pub per_host_concurrency: usize,
    pub per_host_delay_ms: u64,
}

Fields

seed_url: Option<String>

If Some, push this URL as the seed job before running. If None (e.g. Redis consumer-only), just drain the queue.

max_depth: u16

global_concurrency: usize

per_host_concurrency: usize

per_host_delay_ms: u64

Trait Implementations

impl Clone for CrawlConfig

fn clone(&self) -> CrawlConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CrawlConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.