susbot 2.1.0

robots.txt checker for the command line and CI (sus.bot). Installs the same `susbot` program as the susbot-cli crate.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
# susbot

The command-line version of [sus.bot](https://sus.bot/), a robots.txt checker: which search engines and AI crawlers a site lets in, what is wrong with the file, and which paths it reveals.

```
cargo install susbot
susbot https://example.com
```

This crate installs the same `susbot` program as [susbot-cli](https://crates.io/crates/susbot-cli), where the usage is documented. Source and GitHub Action: [github.com/sitefig/robots](https://github.com/sitefig/robots).

- The same tool elsewhere: [susbot on PyPI]https://pypi.org/project/susbot/, [@sitefig/susbot on npm]https://www.npmjs.com/package/@sitefig/susbot

## Licence

[PolyForm Noncommercial 1.0.0](LICENSE.md): free for noncommercial use. Commercial use needs a licence from [Sitefig](https://sitefig.eu/).