rexturl 0.3.2

A simple tool to split urls in their protocol, host, port, path and query parts.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115

# rexturl

A versatile command-line tool for parsing and manipulating URLs.

## Features

- Extract specific URL components (scheme, username, host, port, path, query, fragment)
- Custom output formatting
- JSON output support
- Sorting and deduplication of results
- Process multiple URLs from command line or stdin

## Installation

```bash
cargo install rexturl
```
or clone the repository and build from source:

```bash
git clone https://github.com/vschwaberow/rexturl.git
cd rexturl
cargo build --release
```

## Usage

```bash
rexturl [OPTIONS] [URLS...]
```


If no URLs are provided, rexturl will read from stdin.

## Options

`--urls <URLS>` Input URLs to process
`--scheme` Extract and display the URL scheme
`--username` Extract and display the username from the URL
`--host` Extract and display the hostname
`--port` Extract and display the port number
`--path` Extract and display the URL path
`--query` Extract and display the query string
`--fragment` Extract and display the URL fragment
`--sort` Sort the output
`--unique` Remove duplicate entries from the output
`--json` Output results in JSON format
`--all` Display all URL components
`--custom` Enable custom output mode
`--domain` Extract the domain
`--format <FORMAT>` Custom output format (default: "{scheme}://{host}{path}")
`-h`, `--help` Print help information
`-V`, `--version` Print version information


## Examples

1. Extract all components from a single URL:
   ```bash
   rexturl --all https://user:pass@example.com:8080/path?query=value#fragment
   ```

2. Extract host and port from multiple URLs:
   ```bash
   rexturl --host --port https://example.com https://api.example.com:8443
   ```

3. Process URLs from a file, extracting paths and sorting results:
   ```bash
   cat urls.txt | rexturl --path --sort
   ```

4. Use custom output format:
   ```bash
   rexturl --custom --format "{scheme}://{host}:{port}{path}" https://example.com:8080/api
   ```

5. Output results in JSON format:
   ```bash
   rexturl --json --all https://example.com https://api.example.com
   ```

6. Sort and deduplicate results:
   ```bash
   echo -e "https://example.com\nhttps://example.com\nhttps://api.example.com" | rexturl --host --sort --unique
   ```

## Custom Output Format

When using `--custom` and `--format`, you can use the following placeholders:

- `{scheme}`
- `{username}`
- `{host}` 
- `{domain}`
- `{port}`
- `{path}`
- `{query}`
- `{fragment}`

Example:

```bash
rexturl --custom --format "Host: {host}, Path: {path}" 
https://example.com/api
```


## Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

## License

This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.