Enum CrawlError 

#[non_exhaustive]
pub enum CrawlError {
    Network {
        message: String,
        status_code: Option<u16>,
    },
    Http(String),
    InvalidUrl(String),
    Parse(String),
    RateLimit,
    MaxDepthExceeded {
        current: u8,
        max: u8,
    },
    MaxPagesExceeded {
        max: usize,
    },
    UrlExcluded(String),
    InvalidContentType(String),
    Io(Error),
    Semaphore(String),
    Internal(String),
    Sitemap(String),
}

Crawl errors

Following err-thiserror-for-libraries: Uses thiserror for library error types. Following api-non-exhaustive: Can add variants without breaking changes. Following clean-architecture: NO dependencies on reqwest/anyhow (Infra layer)

Architecture Note

This error type does NOT contain reqwest::Error or anyhow::Error. Those are infrastructure details. The Infrastructure layer converts reqwest::Error → CrawlError::Network and anyhow::Error → specific variants.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Network

Network error during HTTP request

Note: Does NOT contain reqwest::Error (that’s Infra detail). Infrastructure layer converts reqwest::Error → this variant.

Fields

message: String

status_code: Option<u16>

Http(String)

HTTP error (status code or request failure)

InvalidUrl(String)

URL parsing error

Parse(String)

HTML parsing error

RateLimit

Rate limit exceeded

MaxDepthExceeded

Maximum depth exceeded

Fields

current: u8

max: u8

MaxPagesExceeded

Maximum pages exceeded

Fields

max: usize

UrlExcluded(String)

URL excluded by pattern

InvalidContentType(String)

Invalid content type

Io(Error)

I/O error

Semaphore(String)

Semaphore error (concurrency control)

Internal(String)

Internal error (unspecified)

Sitemap(String)

Sitemap parsing error (FASE 3) Note: Does NOT contain sitemap_parser::SitemapError (that’s Infra detail). Infrastructure layer converts SitemapError → this variant.

Trait Implementations

impl Debug for CrawlError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for CrawlError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for CrawlError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0: use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0: replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<Error> for CrawlError

fn from(source: Error) -> Self

Converts to this type from the input type.