Struct CrawlerContext 

pub struct CrawlerContext<S, I>(pub Arc<CrawlerContextInner<S, I>>)
where
    S: Spider<Item = I>,
    I: ScrapedItem;

Aggregated context shared across all crawler tasks.

This struct wraps CrawlerContextInner in a single Arc, allowing efficient cloning with just one atomic reference count operation.

Tuple Fields

0: Arc<CrawlerContextInner<S, I>>

Implementations

impl<S, I> CrawlerContext<S, I>

where S: Spider<Item = I>, I: ScrapedItem,

pub fn new( scheduler: Arc<Scheduler>, stats: Arc<StatCollector>, spider: Arc<S>, spider_state: Arc<S::State>, pipelines: Arc<Vec<Box<dyn Pipeline<I>>>>, ) -> Self

Creates a new CrawlerContext with the given components.

pub fn from_crawler( scheduler: Arc<Scheduler>, stats: Arc<StatCollector>, spider: Arc<S>, spider_state: Arc<S::State>, pipelines: Arc<Vec<Box<dyn Pipeline<I>>>>, ) -> Self

Creates a CrawlerContext from a Crawler instance.

Trait Implementations

impl<S, I> Clone for CrawlerContext<S, I>

where S: Spider<Item = I>, I: ScrapedItem,

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<S, I> Deref for CrawlerContext<S, I>

where S: Spider<Item = I>, I: ScrapedItem,

type Target = CrawlerContextInner<S, I>

The resulting type after dereferencing.

fn deref(&self) -> &Self::Target

Dereferences the value.