Crate wayback

Functions

get_common_crawl_url

Makes a request to commoncrawl.org api and parses the result, returns a vector of urls or None.

get_otx_alienvault_url

Makes a request to otx.alienvault.com api and parses the result, returns a vector of urls or None.

get_virus_total_url

Makes a request to virustotal.com api and parses the result, returns a vector of urls or None.

get_wayback_url

Makes a request to web.archive.org api and parses the result, returns a vector of urls or None.

scan_domain

Scan all sources for one domain and return vector of urls

scan_domains

Scan all sources for list of domains and return vector of urls

unique_result_scan_domain

like scan_domain but return vector of unique sorted urls

unique_result_scan_domains

like scan_domains but return vector of unique sorted urls