Struct SpideryApp 

pub struct SpideryApp { /* private fields */ }

Implementations

impl SpideryApp

pub async fn crawl_url_async( &self, url: impl AsRef<str>, options: Option<CrawlOptions>, ) -> Result<CrawlAsyncResponse, SpideryError>

Initiates a crawl job for a URL using the Spidery API.

pub async fn crawl_url( &self, url: impl AsRef<str>, options: impl Into<Option<CrawlOptions>>, ) -> Result<CrawlStatus, SpideryError>

Performs a crawl job for a URL using the Spidery API, waiting for the end result. This may take a long time depending on the size of the target page and your options (namely CrawlOptions.limit).

pub async fn check_crawl_status( &self, id: impl AsRef<str>, ) -> Result<CrawlStatus, SpideryError>

Checks for the status of a crawl, based on the crawl’s ID. To be used in conjunction with SpideryApp::crawl_url_async.

impl SpideryApp

pub async fn map_url( &self, url: impl AsRef<str>, options: impl Into<Option<MapOptions>>, ) -> Result<Vec<String>, SpideryError>

Returns links from a URL using the Spidery API.

impl SpideryApp

pub async fn scrape_url( &self, url: impl AsRef<str>, options: impl Into<Option<ScrapeOptions>>, ) -> Result<Document, SpideryError>

Scrapes a URL using the Spidery API.

impl SpideryApp

pub fn new(api_key: impl AsRef<str>) -> Result<Self, SpideryError>

pub fn new_selfhosted( api_url: impl AsRef<str>, api_key: Option<impl AsRef<str>>, ) -> Result<Self, SpideryError>

Trait Implementations

impl Clone for SpideryApp

fn clone(&self) -> SpideryApp

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SpideryApp

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.