Struct Retry 

pub struct Retry<F> { /* private fields */ }

A facade that re-queues seeds reported with Report::Retry.

Retried seeds wait in the facade until their delay passes; they are not pushed again, so facades inside it never refuse them. Waiting seeds are held in memory; they are bounded by the requests that failed, not by the size of the frontier. Seeds out of retries are reported inwards as Report::Failed and refused with Ack::RetryRefused.

Implementations

impl<F> Retry<F>

pub fn new(inner: F, policy: RetryPolicy) -> Self

Wraps inner, retrying according to policy.

Trait Implementations

impl<F: Debug> Debug for Retry<F>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<F: Frontier> Frontier for Retry<F>

fn push(&self, seed: Seed) -> impl Future<Output = Result<Admission>> + Send

Offers a seed, which the frontier may refuse.

async fn pop(&self) -> Result<NextSeed>

Takes the next seed that is ready to be crawled.

async fn report(&self, report: Report) -> Result<Ack>

Tells the frontier how a popped seed ended.

fn size_hint(&self) -> Option<usize>

Returns the number of queued seeds, if known.

fn snapshot(&self) -> Option<Vec<Seed>>

Returns a copy of every seed held, in no particular order, to save the crawl and resume it later; None if the frontier cannot, e.g. because it persists seeds itself.