Skip to main content

SpiderError

Enum SpiderError 

Source
pub enum SpiderError {
    Config(String),
    Fetch(FetchError),
    Browser(BrowserError),
    Session(String),
    Checkpoint(String),
    RobotsTxt(String),
    Other(String),
}
Expand description

The central error type for everything that can go wrong during a crawl.

Each variant wraps either a structured error from a downstream crate or a human-readable String describing the problem. You will typically encounter this type through the Result alias rather than constructing it directly.

Variants§

§

Config(String)

A configuration validation error, raised when spider settings are invalid (for example, a negative checkpoint interval). The string describes what was wrong with the configuration.

§

Fetch(FetchError)

An error originating from the HTTP fetch layer (scrapling-fetch). This wraps the underlying FetchError so you can inspect network-level details such as connection timeouts or DNS failures.

§

Browser(BrowserError)

An error originating from the browser automation layer (scrapling-browser). This wraps the underlying BrowserError, which covers headless-browser launch failures, page navigation errors, and similar issues.

§

Session(String)

A session management error, raised when a requested session ID does not exist or when a duplicate session is registered. Check the contained message for the list of available session IDs.

§

Checkpoint(String)

A checkpoint save or restore error, raised when the crawler cannot write or read its state snapshot on disk. Common causes include missing directories and permission problems.

§

RobotsTxt(String)

A robots.txt parsing or enforcement error. In practice this variant is rarely surfaced because the robots.txt manager degrades gracefully (treating unparseable files as “allow all”), but it exists for explicit error paths.

§

Other(String)

A catch-all error for uncategorized failures that do not fit into any other variant. Use this sparingly; prefer a more specific variant when one applies.

Trait Implementations§

Source§

impl Debug for SpiderError

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Display for SpiderError

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Error for SpiderError

1.30.0 · Source§

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any. Read more
1.0.0 · Source§

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

1.0.0 · Source§

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

Source§

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)
Provides type-based access to context intended for error reports. Read more
Source§

impl From<BrowserError> for SpiderError

Source§

fn from(e: BrowserError) -> Self

Converts to this type from the input type.
Source§

impl From<FetchError> for SpiderError

Source§

fn from(e: FetchError) -> Self

Converts to this type from the input type.

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToString for T
where T: Display + ?Sized,

Source§

fn to_string(&self) -> String

Converts the given value to a String. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more