chaintools 0.0.7

work with .chain files in Rust
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51

<p align="center">
  <p align="center">
    <img width=200 align="center" src="../logo.png" >
  </p>

  <span>
    <h1 align="center">
        chaintools
    </h1>
  </span>

  <p align="center">
    <a href="https://img.shields.io/badge/version-0.0.2-green" target="_blank">
      <img alt="Version Badge" src="https://img.shields.io/badge/version-0.0.2-green">
    </a>
    <a href="https://crates.io/crates/chaintools" target="_blank">
      <img alt="Crates.io Version" src="https://img.shields.io/crates/v/chaintools">
    </a>
    <a href="https://github.com/alejandrogzi/chaintools" target="_blank">
      <img alt="GitHub License" src="https://img.shields.io/github/license/alejandrogzi/chaintools?color=blue">
    </a>
    <a href="https://crates.io/crates/chaintools" target="_blank">
      <img alt="Crates.io Total Downloads" src="https://img.shields.io/crates/d/chaintools">
    </a>
  </p>
</p>

# chaintools split 

splits one chain input into multiple files under `<OUTDIR>/chains/`.

Inputs:
- `--chain <PATH>`: input chain file; if omitted, read from standard input

Required split mode:
- `--files <N>`: produce exactly `N` output files
- `--chunks <N>`: produce as many files as needed with at most `N` chains per file

Output:
- `--outdir <PATH>`: base output directory; files are always created under `<PATH>/chains/`
- `--gzip`: gzip-compress every split output file

Distribution:
- `--randomize`/`-R`: distribute chains across output files in random order instead of input order. Useful when the input is sorted by id or score, where the largest chains would otherwise all land in the first file; randomizing spreads them evenly across files.
- `--seed <SEED>`: `u64` seed for `--randomize`, making the shuffle reproducible. When omitted, a time-based seed is chosen and logged at startup so the run can still be reproduced. Requires `--randomize`.

Notes:
- output names use `part.00001.<basename>.chain` and add `.gz` when `--gzip` is used
- if the requested split threshold is larger than the number of chains, the tool produces a single output
- when possible, that single output is created as a symlink to the original input file
- `--randomize` only affects which file each chain lands in; every chain is written exactly once and no bytes are lost