Enum CrawlError 

#[non_exhaustive]
pub enum CrawlError {
    Retry(Error),
    Session(Error),
    ForceRetry(Error),
    NonRetryable(Error),
    Critical(Error),
    MissingRoute {
        label: Option<String>,
        method: Method,
    },
    AntiBotDetected {
        tech: AntiBotTech,
        source: Error,
    },
}

An error produced while processing a crawl request.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Retry(Error)

A retryable error that counts against the request retry limit.

Session(Error)

A retryable error that rotates the current session.

ForceRetry(Error)

A retryable error that ignores the request retry limit.

NonRetryable(Error)

A permanent request error that invokes the failure handler.

Critical(Error)

A critical error that aborts the crawler.

MissingRoute

No registered route matched a request’s label and method.

Fields

label: Option<String>

The request routing label.

method: Method

The request HTTP method.

AntiBotDetected

A known anti-bot or web application firewall response was detected.

Fields

tech: AntiBotTech

The detected anti-bot technology.

source: Error

The underlying detection error.

Implementations

impl CrawlError

pub fn http_status(&self) -> Option<StatusCode>

Returns an HTTP status carried anywhere in the underlying error chain.

pub fn retry_after(&self) -> Option<Duration>

Returns a Retry-After duration carried anywhere in the underlying error chain.

pub fn retry<E: Into<Error>>(error: E) -> Self

Creates a retryable error that counts against the retry limit.

pub fn session<E: Into<Error>>(error: E) -> Self

Creates a retryable error that rotates the current session.

pub fn force_retry<E: Into<Error>>(error: E) -> Self

Creates a retryable error that ignores the retry limit.

pub fn non_retryable<E: Into<Error>>(error: E) -> Self

Creates a permanent, non-retryable request error.

pub fn critical<E: Into<Error>>(error: E) -> Self

Creates a critical error that aborts the crawler.

pub fn fatal<E: Into<Error>>(error: E) -> Self

Creates a permanent error that is never retried and runs the failure handler.

This is an alias for Self::non_retryable.

pub fn is_retryable(&self) -> bool

Returns whether the request should be attempted again.

pub fn rotates_session(&self) -> bool

Returns whether retrying should rotate the current session.

pub fn ignores_max_retries(&self) -> bool

Returns whether the error ignores the request retry limit.

pub fn is_critical(&self) -> bool

Returns whether the error should abort the entire crawler.

pub fn counts_against_retries(&self) -> bool

Returns whether retrying counts against the request retry limit.

Trait Implementations

impl Debug for CrawlError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for CrawlError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for CrawlError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<Error> for CrawlError

fn from(error: Error) -> Self

Converts to this type from the input type.

impl From<Error> for CrawlError

fn from(error: Error) -> Self

Converts to this type from the input type.

impl From<RequestBuildError> for CrawlError

fn from(error: RequestBuildError) -> Self

Converts to this type from the input type.

impl From<StorageError> for CrawlError

fn from(error: StorageError) -> Self

Converts to this type from the input type.