Expand description
What a crawl produces: pages, the link graph and why it stopped.
Structs§
- Crawl
Output - Edge
- One internal link between two crawled pages.
- Link
Graph - Links between crawled pages, with anchor text interned so repeated navigation links don’t repeat their text.
- Progress
- A snapshot of a running crawl, for progress display.
Enums§
- Stop
Reason - Why a crawl ended.