#url #parallel #performance #parser #clutter

app ureld

Ureld is a simple & fast URLs de-cluttering tool written in Rust

3 releases

Uses new Rust 2024

new 0.1.41 Feb 13, 2026
0.1.4 Feb 10, 2026
0.1.3 Feb 10, 2026
0.1.2 Feb 10, 2026
0.1.1 Feb 10, 2026

#11 in Security

GPL-3.0-only

100KB
109 lines

Ureld

Ureld is a simple & fast URLs de-cluttering tool written in Rust.

image

Ureld receiving input from STDIN, passthrough into filter then goes brrr...

cat urls.txt | ureld

Ureld doesn't make any internet requests. Ureld follow Unix philosophy within lean toward into security testing or bug bounty use cases.

Features

  • Decluttering your messy URLs.
  • Filter unneeded URLs.
    • http(s)://example.com/
    • http(s)://example.com/blog/
    • http(s)://example.com/blog/#blog
  • Filter unneeded Exts.
    • css, jpg, jpeg, png, gif, webp
    • woff2, woff, ttf, ico
  • API version awareness v(x).
    • example.com/1/api_v2?p=val&x=y
    • example.com/1/apiv3?p=val
    • example.com/1/api-v3?p=val
    • example.com/v2/api?p=val&y=z
    • example.com/v3/api?p=val
  • Faster than your nextdoor Wi-Fi.

Install

Here you can find lastest update executable binaries or using cargo at creates.io.

cargo install ureld

Usages

Basic Usage

ureld < urls.txt

OR

cat urls.txt | ureld

URLs contain parameter.

cat urls.txt | ureld | grep "="

URLs aren't parameter (just file exts).

cat urls.txt | ureld | grep -v "="

URLs contain .js file.

cat urls.txt | ureld | grep ".js$"

URLs aren't .js file.

cat urls.txt | ureld | grep -v ".js$"

Advanced Usage

URLs contain .js and .html file. (use grep -v for negated)

cat urls.txt | ureld | grep ".js$\|.html$"

Ureld build with love within 1337 cups of coffee, inspired by uro and urldedupe.

Comparison

Comparing Ureld with other tools using +10 million list of URLs.

image

Happy Hacking.

Dependencies

~3.5–4.5MB
~83K SLoC