Struct CrawlerHandle 

pub struct CrawlerHandle { /* private fields */ }

A cheaply cloned weak back-reference to a running crawler.

Implementations

impl CrawlerHandle

pub async fn add_requests( &self, reqs: impl IntoIterator<Item = Request> + Send, ) -> Result<BatchAddHandle, CrawlError>

Adds requests to the crawler’s queue.

pub async fn add_requests_with_options( &self, reqs: impl IntoIterator<Item = Request> + Send, options: AddOptions, ) -> Result<BatchAddHandle, CrawlError>

Adds requests with explicit queue insertion options.

pub fn stats(&self) -> Option<StatisticsSnapshot>

Returns a snapshot of live crawl statistics while the crawler exists.

pub fn autoscaler_snapshot(&self) -> Option<AutoscalerSnapshot>

Returns a snapshot of the concurrency scaler while the crawler exists.

pub fn events(&self) -> Option<EventStream>

Subscribes to control-plane crawler events while the crawler exists.

pub fn results(&self) -> Option<ResultStream>

Subscribes to terminal request snapshots while the crawler exists.

pub fn request_queue(&self) -> Option<Arc<dyn RequestQueue>>

Returns the crawler’s request queue while the crawler exists.

pub fn crawl_policy(&self) -> Option<Arc<CrawlPolicy>>

Returns the configured crawl policy while the crawler exists.

pub fn stop(&self)

Requests a graceful stop that finishes in-flight work and fetches no more requests.

pub fn abort(&self)

Requests immediate cancellation of crawler work.

Trait Implementations

impl Clone for CrawlerHandle

fn clone(&self) -> CrawlerHandle

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CrawlerHandle

fn fmt(&self, formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.