rust-parallel-0.1.6 is not a library.

rust-parallel

Run commands in parallel, like a simple rust verision of GNU Parallel.

Just starting - more options to come :)

Usage:

Run commands from stdin in parallel

Usage: rust-parallel [OPTIONS]

Options:
  -j, --jobs <JOBS>    Maximum number of commands to run in parallel, defauts to num cpus [default: 8]
  -s, --shell-enabled  Use /bin/sh shell to run commands, defaults to false
  -h, --help           Print help information
  -V, --version        Print version information

Little demo:

$ cargo build -v

$ cat test
echo hi
echo there
echo how
echo are
echo you

$ cat test | ./target/debug/rust-parallel -j5
are
hi
there
how
you

Using awk to form commands:

$ head -100 /usr/share/dict/words| awk '{printf "md5 -s %s\n", $1}' | ./target/debug/rust-parallel
MD5 ("Abba") = 5fa1e1f6e07a6fea3f2bb098e90a8de2
MD5 ("abaxial") = ac3a53971d52d9ce3277eadf03f13a5e
MD5 ("abaze") = 0b08c52aa63d947b6a5601ee975bc3a4
MD5 ("abaxile") = 21f5fc27d7d34117596e41d8c001087e
MD5 ("abbacomes") = 76640eb0c929bc97d016731bfbe9a4f8
MD5 ("abbacy") = 08aeac72800adc98d2aba540b6195921
MD5 ("Abbadide") = 7add1d6f008790fa6783bc8798d8c803
MD5 ("abb") = ea01e5fd8e4d8832825acdd20eac5104

With debug logs enabled:

$ cat test | RUST_LOG=debug ./target/debug/rust-parallel
2022-11-26T21:27:29.942045Z DEBUG rust_parallel: begin main
2022-11-26T21:27:29.942807Z DEBUG rust_parallel: command_line_args = CommandLineArgs { jobs: 8, shell_enabled: false }
2022-11-26T21:27:29.943019Z DEBUG rust_parallel: read line echo hi
2022-11-26T21:27:29.943092Z DEBUG rust_parallel: read line echo there
2022-11-26T21:27:29.943137Z DEBUG rust_parallel: read line echo how
2022-11-26T21:27:29.943182Z DEBUG rust_parallel: read line echo are
2022-11-26T21:27:29.943211Z DEBUG rust_parallel: read line echo you
2022-11-26T21:27:29.943372Z DEBUG rust_parallel: after spawn_commands join_set.len() = 5
2022-11-26T21:27:29.946177Z DEBUG rust_parallel: got command status = exit status: 0
2022-11-26T21:27:29.946173Z DEBUG rust_parallel: got command status = exit status: 0
there
how
2022-11-26T21:27:29.946242Z DEBUG rust_parallel: got command status = exit status: 0
hi
2022-11-26T21:27:29.946301Z DEBUG rust_parallel: got command status = exit status: 0
2022-11-26T21:27:29.946317Z DEBUG rust_parallel: join_next result = Ok(CommandInfo { _line_number: 2, command: "echo there", shell_enabled: false })
2022-11-26T21:27:29.946303Z DEBUG rust_parallel: got command status = exit status: 0
you
are
2022-11-26T21:27:29.946361Z DEBUG rust_parallel: join_next result = Ok(CommandInfo { _line_number: 3, command: "echo how", shell_enabled: false })
2022-11-26T21:27:29.946560Z DEBUG rust_parallel: join_next result = Ok(CommandInfo { _line_number: 1, command: "echo hi", shell_enabled: false })
2022-11-26T21:27:29.946585Z DEBUG rust_parallel: join_next result = Ok(CommandInfo { _line_number: 5, command: "echo you", shell_enabled: false })
2022-11-26T21:27:29.946603Z DEBUG rust_parallel: join_next result = Ok(CommandInfo { _line_number: 4, command: "echo are", shell_enabled: false })
2022-11-26T21:27:29.946619Z DEBUG rust_parallel: end main

rust-parallel 0.1.6

rust-parallel