codoseo-crawler 0.0.1

The CodoSEO crawler: fetching, robots.txt, sitemaps and streaming field extraction.
Documentation
1
<html><head><link rel="canonical" href="page"><base href="https://cdn.test/docs/"><base href="https://ignored.test/"></head><body><a href="intro">Intro</a></body></html>