s3ueeze 0.1.0

Download and merge JSON files from S3
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
13
# s3ueeze

Have you had a _bunch_ offiles in S3 that you want to munge together? `s3ueeze`
will walk through all the _sources_ you pass to it, grab all the files therein,
and write them to a single output file you specify.

## Formats

`s3ueeze` works with any newline-delimited data format. To optimize memory
usage, `s3ueeze` works line-wise on the data, so there's no ordering guarantee.
Lines from multiple input files **will** be interleaved in the output.

JSON Lines (<https://jsonlines.org/>)