website_crawler 0.2.4

crawl all urls on a website async & sync
Documentation