Struct RobotsMatcher 

pub struct RobotsMatcher<'a> { /* private fields */ }

Precompiled matcher for repeated access checks against one RobotsTxt.

Build this with RobotsTxt::matcher when checking many paths against the same parsed file. Construction allocates an index and precomputes rule metadata, so RobotsTxt::is_allowed remains the lower-overhead option for one-off checks.

Implementations

impl<'a> RobotsMatcher<'a>

pub fn is_allowed(&self, user_agent: &str, path: &str) -> bool

Returns whether user_agent may crawl path using the prebuilt index.

This has the same access semantics as RobotsTxt::is_allowed, including exact user-agent precedence over *, merged exact groups, longest-match rule selection, Allow tie wins, and implicit allowance for /robots.txt.

Trait Implementations

impl<'a> Clone for RobotsMatcher<'a>

fn clone(&self) -> RobotsMatcher<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for RobotsMatcher<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.