fastmash 0.3.0

Fast command-line statistics on text data, compatible with GNU datamash
fastmash-0.3.0 is not a library.
Visit the last successful build: fastmash-0.0.0

Fastmash summarizes, groups and reshapes tab-separated text and quoted CSV from the command line. It accepts the command language of GNU datamash, so most existing scripts can switch by changing one word.

$ printf 'site\treading\nwest\t2\neast\t4\nwest\t6\n' | fastmash -H -s -g site sum reading mean reading
GroupBy(site)	sum(reading)	mean(reading)
east	4	4
west	8	4

Why Fastmash

  • Speed. Up to four times faster than GNU datamash 1.9 in published Linux benchmarks.
  • Familiar commands. Over 70 operations and modes, with grouping, headers, field selectors, percentiles, crosstab and transpose.
  • CSV and table tools. Read and write quoted CSV, name result columns, calculate weighted means, select top records, compare datasets and check table health.
  • Repeatable results. Software arithmetic gives identical numerical results across supported machines for the same input, settings and Fastmash version.

Install

Fastmash runs on Linux x86-64 (glibc), Windows through WSL2 and Apple Silicon macOS 15 and later.

Download a prebuilt binary from the releases page, or install with Cargo on Linux or WSL2.

cargo install --locked fastmash

On Apple Silicon macOS

cargo install --locked --bin fastmash fastmash

The installation guide also covers Homebrew, Linux packages and the quick installer.

Quick start

# Sum CSV revenue by region and name the result column
fastmash --csv -H -s -g region --result-name=1:total sum revenue < sales.csv

# Weighted mean and the highest five complete records
fastmash -H wmean price:units < sales.tsv
fastmash --csv -H top:5 revenue < sales.csv

# Check table health and compare summaries of two exports
fastmash --header-in health type revenue number nonmissing id validate < sales.tsv
fastmash --csv -H -g region compare before.csv after.csv sum revenue

Use --csv for quoted CSV and -H to select fields by header name. The user guide covers all operations and options.

Compatibility

Fastmash implements the GNU datamash 1.9 command language. See the migration guide to switch existing scripts and the documented differences for compatibility details.

Documentation

Contributing

Found a bug or have a workload to share? Open an issue or read the contributing guide. Report vulnerabilities through the security policy.