Function indexability 

pub fn indexability(
    url: &Url,
    status: u16,
    fields: &PageFields,
    robots_blocked: bool,
) -> Indexability

Whether search engines would index this URL. Status 0 (no response) counts as a server error.