unobtanium-crawler 3.0.0

The default web-crawler for unobtanium.
unobtanium-crawler-3.0.0 is not a library.

unobtanium-crawler

Manual | Codeberg

The unobtanium-crawler is the web crawler of the unobtanium search engine.

It is responsible for crawling websites and turning the result into a searchable index.

It is published under an AGPL-3.0-only license.

Learn more about unobtanium.