robotstxt-with-cache 0.4.0

A native Rust port of Google's robots.txt parser and matcher C++ library.
Documentation
# Generated by Cargo
# will have compiled files and executables
/target/
# These are backup files generated by rustfmt
**/*.rs.bk
*.txt
.idea
.DS_Store
tests/target
simple_test
# CMake test directory
c-build
# Added by cargo
Cargo.lock