Ureld

Ureld is a simple & fast URLs de-cluttering tool written in Rust.

Ureld receiving input from STDIN, passthrough into filter then goes brrr...

cat urls.txt | ureld

Ureld doesn't make any internet requests. Ureld follow Unix philosophy within lean toward into security testing or bug bounty use cases.

Features

• Decluttering your messy URLs.
• Filter unneeded URLs.
  • http(s)://example.com/
  • http(s)://example.com/blog/
  • http(s)://example.com/blog/#blog
• Filter unneeded Exts.
  • css, jpg, jpeg, png, gif, webp
  • woff2, woff, ttf, ico
• Merging numeric path.
  • example.com/2/index.html
  • example.com/0/index.html
  • example.com/1/index.html
• API version awareness v(numeric).
  • example.com/1/api_v2?p=val&x=y
  • example.com/1/apiv3?p=val
  • example.com/1/api-v3?p=val
  • example.com/v2/api?p=val&y=z
  • example.com/v3/api?p=val
• Case sensitive awareness
  • example.com/blog/index.html
  • example.com/Blog/index.html
  • example.com/BLOG/index.html
• Faster than your nextdoor Wi-Fi.

Install

Here you can find lastest update executable binaries or using command below.

curl -sLO https://codeberg.org/zuhry/ureld/releases/download/v0.1.42/{ureld_$(uname -m)-unknown-linux-gnu.zip,ureld_$(uname -m)-unknown-linux-gnu.zip.sha512} | sha512sum -c
unzip ureld_$(uname -m)-unknown-linux-gnu.zip
chmod +x ureld

Change to latest update if VERSION eg. vX.X.X already outdated.

or using cargo at creates.io.

cargo install --git https://codeberg.org/zuhry/ureld.git

or the shortest option.

cargo install ureld 

Usages

Basic Usage

ureld < urls.txt

OR

cat urls.txt | ureld

URLs contain parameter.

cat urls.txt | ureld | grep "="

URLs aren't parameter (just file exts).

cat urls.txt | ureld | grep -v "="

URLs contain .js file.

cat urls.txt | ureld | grep ".js$"

URLs aren't .js file.

cat urls.txt | ureld | grep -v ".js$"

Advanced Usage

URLs contain .js and .html file. (use grep -v for negated)

cat urls.txt | ureld | grep ".js$\|.html$"

Ureld built with love within 1337 cups of coffee, inspired by uro and urldedupe.

Comparison

Comparing Ureld with other tools using +10 million list of URLs.

Here is detail comparison table:

Happy hacking.