Skip to main content

Module page

Module page 

Source
Expand description

One crawled URL and the fields pulled out of it.

Structs§

OgTags
PageFields
PageRecord

Enums§

FetchFailure
Why a fetch produced no response.
Indexability
JsonLdStatus

Functions§

indexability
Whether search engines would index this URL. Status 0 (no response) counts as a server error.
is_nofollow
nofollow or none in the meta robots tag or the X-Robots-Tag header.
is_noindex
noindex or none in the meta robots tag or the X-Robots-Tag header.