codoseo-crawler 0.0.1

The CodoSEO crawler: fetching, robots.txt, sitemaps and streaming field extraction.
Documentation
1
<html><head><script type="application/ld+json">{"@type":"Organization","name":"N"}</script><script type="application/ld+json">[{"@type":"WebSite"}]</script></head><body>x</body></html>