docbox-web-scraper 0.6.0

Web scraping logic for docbox, document parsing, favicon resolution, ogp resolution
Documentation

Docbox Web Scraper

Web scraper library for docbox, handles scraping websites for things like ogp metadata, and favicons. Enforces rules that protect the local network from being attached through SRF attacks and respects rules such as robots.txt