Expand description
§use-robots
Robots and indexing directive primitives for RustUse.
§Example
use use_robots::{FollowDirective, IndexDirective, RobotsDirective};
let directive = RobotsDirective::new(IndexDirective::NoIndex, FollowDirective::NoFollow);
assert_eq!(directive.to_meta_content(), "noindex,nofollow");§Scope
- Robots directives, indexing/follow/snippet/archive labels, bot names, and common combinations.
§Non-goals
- robots.txt crawling, fetching, cache behavior, or bot-specific policy engines.
§License
Licensed under either Apache-2.0 or MIT, at your option.
Structs§
- BotName
- Bot name label used with robots directives.
- Robots
Directive - A robots directive set suitable for meta content formatting.
Enums§
- Archive
Directive - Archive directive.
- Follow
Directive - Link-following directive.
- Index
Directive - Indexing directive.
- Robots
Value Error - Error returned by robots primitive constructors.
- Snippet
Directive - Snippet directive.