Enum Outcome 

pub enum Outcome {
    Continue,
    Retry {
        after: Option<Duration>,
    },
    Backoff {
        scope: Scope,
        duration: Duration,
    },
    Abort(Scope),
    Stop,
    Fail(Error),
}

What the crawler should do after a worker handled a request.

Variants

Continue

The request is done.

Retry

Try the request again, after the given delay or the frontier’s default delay.

Fields

after: Option<Duration>

Delay before the next attempt; None defers to the frontier.

Backoff

Pause every request in scope for duration, then try this request again. Typically returned on 429 Too Many Requests.

Fields

scope: Scope

The requests to pause.

duration: Duration

How long to pause them.

Abort(Scope)

Stop crawling scope: its queued requests are skipped from now on. Returned on the first request of a tag, this drops the whole tag.

Stop

Stop the crawl: requests in flight finish, nothing new starts.

Fail(Error)

The request failed. Retryable errors are tried again, others are recorded as failures.

Implementations

impl Outcome

pub const fn retry() -> Self

Retries the request after the frontier’s default delay.

pub const fn retry_after(delay: Duration) -> Self

Retries the request after delay.

pub const fn backoff(duration: Duration) -> Self

Pauses requests with the same tag as this one for duration.

pub const fn abort() -> Self

Skips every further request with the same tag as this one.

pub fn abort_tag(tag: impl Into<Tag>) -> Self

Skips every further request with tag.

pub fn backoff_tag(tag: impl Into<Tag>, duration: Duration) -> Self

Pauses requests with tag for duration.

Trait Implementations

impl Debug for Outcome

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Outcome

fn default() -> Self

Returns the “default value” for a type.

impl IntoOutcome for Outcome

fn into_outcome(self) -> Outcome

Converts self into an Outcome.