1 2 3 4
# Docbox Web Scraper Web scraper library for docbox, handles scraping websites for things like ogp metadata, and favicons. Enforces rules that protect the local network from being attached through SRF attacks and respects rules such as robots.txt