Enum CrawlScope 

pub enum CrawlScope {
    PathPrefix,
    SameHost,
    SameHostAndSubdomains,
    Allowlist(Vec<CompactString>),
}

Which discovered links the crawler follows.

Variants

PathPrefix

Only links at or below the parent URL’s path (the default).

SameHost

Any link on the same host.

SameHostAndSubdomains

The host and its subdomains.

Allowlist(Vec<CompactString>)

Only hosts matching the allowlist (exact host or .suffix).

Implementations

impl CrawlScope

pub fn allows(&self, root: &Url, candidate: &Url) -> bool

Whether candidate is in scope relative to the crawl root. Allocation-free (runs once per discovered link on the crawl hot path).

Trait Implementations

impl Clone for CrawlScope

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CrawlScope

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CrawlScope

fn default() -> Self

Returns the “default value” for a type.