Enum SpiderOutput 

pub enum SpiderOutput {
    Item(Value),
    FollowRequest(Request),
}

The result of processing a response: either a scraped data item or a follow-up request to enqueue.

Your Spider::parse implementation (or a per-request Callback) returns a Vec<SpiderOutput>. The crawler engine collects Item values into the final ItemList and feeds FollowRequest values back into the Scheduler.

Variants

Item(Value)

A scraped data item to be collected. The JSON value is passed through the spider’s on_scraped_item hook before being stored, which gives you a chance to validate, transform, or drop it.

FollowRequest(Request)

A new request to enqueue for crawling. The engine checks domain restrictions and deduplication before actually scheduling it.

Trait Implementations

impl Debug for SpiderOutput

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.