Module feroxbuster::extractor

Functions

extract_robots_txt	Entry point to perform link extraction from robots.txt
get_links	Given a reqwest::Response, perform the following actions
request_feroxresponse_from_new_link	Wrapper around link extraction logic currently used in two places:
request_robots_txt	helper function that simply requests /robots.txt on the given url's base url