s3rs 0.2.7

A s3 cli client with multi configs with diffent provider
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107

s3rs 
---
[![Build Status](https://travis-ci.com/yanganto/s3rs.svg?branch=master)](https://travis-ci.com/yanganto/s3rs)  

an **S3** **R**ich **S**upport client
- rust edition 2018
- multi config (please put config files under `~/.config/s3rs`)
- interactive command line tool
- easy to debug with http protocol
- AWS4, AWS2 support
- support http redirect for multi region of AWS S3
- support automatically multipart upload

current status:  

| COMMAND                                                              | FUNCTION                                       | CEPH | AWS |
|----------------------------------------------------------------------|------------------------------------------------|------|-----|
| ls                                                                   | list all buckets                               | O    | O   |
| mb _bucket_                                                          | create bucket                                  | O    | O   |
| rb _bucket_                                                          | delete bucket                                  | O    | O   |
| put <file> s3://_bucket_/_object_                                    | upload the file                                | O    | O   |
| put <file> s3://_bucket_                                             | upload the file (file name as object name)     | O    | O   |
| put test s3://_bucket_/_object_                                      | upload a test file sepcific object name        | O    | O   |
| get s3://_bucket_/_object_ _file_                                    | download object                                | O    | O   |
| get s3://_bucket_/_object_                                           | download object in current folder              | O    | O   |
| cat s3://_bucket_/_object_                                           | show the object content                        | O    | O   |
| del s3://_bucket_/_object_ [delete-marker:true] [secure-delete:true] | delete the object (with flag)                  | O    | O   |
|                                                                      | delete-marker used in AWS                      |      |     |
|                                                                      | secure-delete used in BIGTERA(customized CEPH) |      |     |
| tag list s3://_bucket_/_object_                                      | list tag(s) to the object                      | O    | O   |
| tag ls s3://_bucket_/_object_                                        | list tag(s) to the object                      | O    | O   |
| tag add s3://_bucket_/_object_ _key1_=_value1_ [_key2_=_value2_] ... | add tag(s) to the object                       | O    | O   |
| tag put s3://_bucket_/_object_ _key1_=_value1_ [_key2_=_value2_] ... | add tag(s) to the object                       | O    | O   |
| tag del s3://_bucket_/_object_                                       | remove tag(s) from the object                  | O    | O   |
| tag rm s3://_bucket_/_object_                                        | remove tag(s) from the object                  | O    | O   |
| /uri?query                                                           | give the orignal url                           | O    | O   |

| HIGH LEVEL COMMAND        | INTEGRATE FUNCTIONS                                                                      | CEPH | AWS |
|---------------------------|------------------------------------------------------------------------------------------|------|-----|
| la                        | list all objects                                                                         | O    | O   |
| ls _bucket_               | list objects in the bucket                                                               | O    | O   |
| ls s3://_bucket_          | list objects in the bucket                                                               | O    | O   |
| ls s3://_bucket_/_prefix_ | list objects match prefix in the bucket                                                  | O    | O   |
| ll                        | list all objects details (storage class, modify time, etag)                              | O    | O   |
| ll s3://_bucket_          | list objects detail in the bucket                                                        | O    | O   |
| ll s3://_bucket_/_prefix_ | list objects match prefix detail in the bucket                                           | O    | O   |
| info s3://_bucket_        | acl(ceph, aws), location(ceph, aws), versioning(ceph, aws), uploads(ceph), version(ceph) | O    | O   |

| CEPH OPS API (use system keys) | CEPH ONLY FUNCTION    |
|--------------------------------|-----------------------|
| usage s3://_bucket_            | show the bucket usage |


| SHELL SETTING COMMAND         | FUNCTION                                 |
|-------------------------------|------------------------------------------|
| s3\_type [ceph/aws/aws4/aws2] | change the api for different S3 providor |
| log [trace/debug/info/erro]   | change the log level                     |
|                               | - Info : for Http header and body        |
|                               | - debug: for auth signature hash info    |
|                               | - trace: more detail about rust          |
| logout                        | logout and reselect user                 |
| Ctrl + d                      | logout and reselect user                 |


| S3 TYPE | AUTH TYPE | FORMAT | URL STYLE            |
|---------|-----------|--------|----------------------|
| ceph    | aws4      | json   | path-style           |
| aws     | aws4      | xml    | virtual-hosted–style |

# Download excutable binary
Download the link as follow and unzip
- https://github.com/yanganto/s3rs/releases/download/v0.2.6/s3rs-v0.2.6-linux.zip

# Install via Crate.io
Install rust tools rustup and cargo 
- `curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh`

Additional package for ubuntu
- `apt-get install libssl-dev pkg-config openssl`

It is easy to install s3rs via cargo as following command.
- `cargo install s3rs`

Set up the path for rust binnary
- `export PATH=$PATH:~/.cargo/bin`

The config file will auto setup when binary first time launch
- `s3rs`

edit the config file at ~/.s3rs.toml
- `vi ~/.s3rs.toml`


# Develop
Install rust tools rustup and cargo 
- `curl https://sh.rustup.rs -sSf | sh`
- `git clone https://github.com/yanganto/s3rs.git`
- `cargo test`
- `cargo build`
- The excutable binary will in `./target/debug/s3rs`

# Demo
- A short demo [video](https://youtu.be/MtPYhJnbMfs)
- snapshot
[![snapshot](https://raw.githubusercontent.com/yanganto/s3rs/master/example.png)](https://youtu.be/MtPYhJnbMfs)
[![snapshot](https://raw.githubusercontent.com/yanganto/s3rs/master/example2.png)](https://youtu.be/MtPYhJnbMfs)