Struct ParsedRobotsKey 

pub struct ParsedRobotsKey { /* private fields */ }

A robots.txt has lines of key/value pairs. A ParsedRobotsKey represents a key.

This class can parse a text-representation (including common typos) and represent them as an enumeration which allows for faster processing afterwards. For unparsable keys, the original string representation is kept.

Implementations

impl ParsedRobotsKey

pub fn parse(&mut self, key: &str)

Parse given key text. Does not copy the text, so the text_key must stay valid for the object’s life-time or the next parse() call.

pub fn get_type(&self) -> &ParseKeyType

Returns the type of key.

pub fn get_unknown_text(&self) -> String

If this is an unknown key, get the text.

Trait Implementations

impl Default for ParsedRobotsKey

fn default() -> Self

Returns the “default value” for a type.