Docbox Web Scraper
Web scraper library for docbox, handles scraping websites for things like ogp metadata, and favicons. Enforces rules that protect the local network from being attached through SRF attacks and respects rules such as robots.txt
Web scraper library for docbox, handles scraping websites for things like ogp metadata, and favicons. Enforces rules that protect the local network from being attached through SRF attacks and respects rules such as robots.txt