use-robots 0.0.1

Robots and indexing directive primitives for RustUse
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25

# use-robots

Robots and indexing directive primitives for `RustUse`.

## Example

```rust
use use_robots::{FollowDirective, IndexDirective, RobotsDirective};

let directive = RobotsDirective::new(IndexDirective::NoIndex, FollowDirective::NoFollow);

assert_eq!(directive.to_meta_content(), "noindex,nofollow");
```

## Scope

- Robots directives, indexing/follow/snippet/archive labels, bot names, and common combinations.

## Non-goals

- robots.txt crawling, fetching, cache behavior, or bot-specific policy engines.

## License

Licensed under either Apache-2.0 or MIT, at your option.