Function crawl 

pub async fn crawl(
    cfg: CrawlConfig,
    on_progress: impl Fn(Progress) + Send + Sync,
) -> Result<CrawlOutput, CrawlError>

Crawls cfg.start_url with its own in-flight cap of politeness.max_in_flight.