rwalk 0.2.5

A blazing fast web directory scanner written in Rust. It's like dirsearch but faster and with less features.

Features

• Multi-threaded
• Recursive directory scanning
• Custom wordlists (merge multiple wordlists, filter out words, etc.)
• Write results to file (JSON, CSV, etc.)
• Configurable request parameters (headers, cookies, etc.)
• Save progress to resume later
• Proxy support
• Request throttling

From crates.io

Installation

cargo install rwalk

Running

rwalk https://example.com path/to/wordlist.txt

From source

Installation

git clone https://github.com/cestef/rwalk.git
cd rwalk

Running

With just

just run https://example.com path/to/wordlist.txt

With cargo

cargo run --release -- https://example.com path/to/wordlist.txt

Usage

You can run rwalk --help to see the usage information:

Usage: rwalk [OPTIONS] <URL> <WORDLISTS>...

Arguments:
  <URL>           Target URL
  <WORDLISTS>...  Wordlist(s)

Options:
  -t, --threads <THREADS>
          Number of threads to use
  -d, --depth <DEPTH>
          Maximum depth to crawl [default: 1]
  -o, --output <OUTPUT>
          Output file
  -T, --timeout <TIMEOUT>
          Request timeout in seconds [default: 10]
  -u, --user-agent <USER_AGENT>
          User agent
  -q, --quiet
          Quiet mode
  -m, --method <METHOD>
          HTTP method [default: GET]
  -d, --data <DATA>
          Data to send with the request
  -H, --headers <key:value>
          Headers to send
  -c, --cookies <key=value>
          Cookies to send
  -I, --case-insensitive
          Case insensitive
  -F, --follow-redirects <FOLLOW_REDIRECTS>
          Follow redirects [default: 0]
  -R, --throttle <THROTTLE>
          Request throttling (requests per second) per thread [default: 0]
  -h, --help
          Print help
  -V, --version
          Print version

Note: The throttling value will be multiplied by the number of threads. For example, if you have 10 threads and a throttling value of 5, the total number of requests per second will be 50.

Benchmarks

The following benchmarks were run on a 2023 MacBook Pro with an M3 Pro chip on a 10 Gbps connection via WiFi. The target was http://ffuf.me/cd/basic and the wordlist was common.txt.

Each tool was run 10 times with 100 threads. The results are below:

ffuf is the fastest tool... but not by much. rwalk is only 1.15x slower than ffuf and ~2.5x faster than dirsearch. Not bad for a first release!

License

Licensed under the MIT License.