Skip to main content

Crate use_robots

Crate use_robots 

Source
Expand description

§use-robots

Robots and indexing directive primitives for RustUse.

§Example

use use_robots::{FollowDirective, IndexDirective, RobotsDirective};

let directive = RobotsDirective::new(IndexDirective::NoIndex, FollowDirective::NoFollow);

assert_eq!(directive.to_meta_content(), "noindex,nofollow");

§Scope

  • Robots directives, indexing/follow/snippet/archive labels, bot names, and common combinations.

§Non-goals

  • robots.txt crawling, fetching, cache behavior, or bot-specific policy engines.

§License

Licensed under either Apache-2.0 or MIT, at your option.

Structs§

BotName
Bot name label used with robots directives.
RobotsDirective
A robots directive set suitable for meta content formatting.

Enums§

ArchiveDirective
Archive directive.
FollowDirective
Link-following directive.
IndexDirective
Indexing directive.
RobotsValueError
Error returned by robots primitive constructors.
SnippetDirective
Snippet directive.