Skip to main content

map_http

browser_automation_cli::scrape_local

Function map_http 

Source 
pub async fn map_http(
    seed: &str,
    robots: RobotsPolicy,
    limit: usize,
    max_depth: usize,
) -> Result<Value, CliError>
Expand description

Map site: collect unique URLs via BFS without full content (links format).