Crate stream_crawler

Source

Structs§

ProcessedUrl
Represents a processed URL.

Functions§

extract_urls_from_a_tags
Extracts URLs from the tags in the given HTML string.
scrape
Scrapes the given URLs, returning a stream of processed URLs.