website_crawler 0.2.1

crawl all urls on a website async & sync
Documentation