Enum SpiderError 

pub enum SpiderError {
    ReqwestError(ReqwestError),
    UrlParseError(ParseError),
    JsonError(String),
    IoError(String),
    ConfigurationError(String),
    GeneralError(String),
    ItemToStringError(String),
    ItemSerializationError(String),
    Unknown,
    InvalidHeaderValue(String),
    HeaderValueError(String),
    HtmlParseError(String),
    Utf8Error(Utf8Error),
    PipelineError(PipelineError),
    BlockedByRobotsTxt,
}

Main runtime error type used across the crawler stack.

Variants

• Network Errors: ReqwestError for HTTP client errors
• URL Errors: UrlParseError for invalid URLs
• Serialization Errors: JsonError for JSON parsing/serialization
• I/O Errors: IoError for file system operations
• Configuration Errors: ConfigurationError for invalid settings
• Pipeline Errors: PipelineError for item processing failures
• HTML/UTF-8 Errors: Parse errors for HTML and UTF-8 content
• Robots.txt: BlockedByRobotsTxt for blocked requests

Example

use spider_util::error::SpiderError;
use url::Url;

// Handle different error types
match Url::parse("not-a-url").map_err(SpiderError::from) {
    Ok(url) => println!("Valid URL: {}", url),
    Err(SpiderError::UrlParseError(e)) => println!("Invalid URL: {}", e),
    Err(e) => println!("Other error: {}", e),
}

Variants

ReqwestError(ReqwestError)

HTTP client error.

UrlParseError(ParseError)

URL parsing error.

JsonError(String)

JSON parsing or serialization error.

IoError(String)

I/O operation error.

ConfigurationError(String)

Invalid configuration error.

GeneralError(String)

General unspecified error.

ItemToStringError(String)

Failed to convert item to string.

ItemSerializationError(String)

Item serialization error.

Unknown

Unknown error.

InvalidHeaderValue(String)

Invalid HTTP header value.

HeaderValueError(String)

HTTP header value error.

HtmlParseError(String)

HTML parsing error.

Utf8Error(Utf8Error)

UTF-8 decoding error.

PipelineError(PipelineError)

Pipeline processing error.

BlockedByRobotsTxt

Request blocked by robots.txt.

Trait Implementations

impl Clone for SpiderError

fn clone(&self) -> SpiderError

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SpiderError

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Display for SpiderError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Error for SpiderError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<Box<ErrorKind>> for SpiderError

fn from(err: Box<ErrorKind>) -> SpiderError

Converts to this type from the input type.

impl From<Error> for SpiderError

fn from(err: Error) -> SpiderError

Converts to this type from the input type.

impl From<Error> for SpiderError

fn from(err: Error) -> SpiderError

Converts to this type from the input type.

impl From<Error> for SpiderError

fn from(err: Error) -> SpiderError

Converts to this type from the input type.

impl From<Error> for SpiderError

fn from(err: Error) -> SpiderError

Converts to this type from the input type.

impl From<InvalidHeaderValue> for SpiderError

fn from(err: InvalidHeaderValue) -> SpiderError

Converts to this type from the input type.

impl From<ParseError> for SpiderError

fn from(source: ParseError) -> SpiderError

Converts to this type from the input type.

impl From<PipelineError> for SpiderError

fn from(source: PipelineError) -> SpiderError

Converts to this type from the input type.

impl From<ReqwestError> for SpiderError

fn from(source: ReqwestError) -> SpiderError

Converts to this type from the input type.

impl From<Utf8Error> for SpiderError

fn from(source: Utf8Error) -> SpiderError

Converts to this type from the input type.