A Bytecode Alliance project
Installation
Precompiled artifacts built on CI are available for download for each release.
To build from source first install Rust for your platform and then use the included Cargo package manager to install:
$ cargo install --locked wasm-tools
Alternatively if you use cargo binstall then that can be used
to install the precompiled artifacts instead:
$ cargo binstall wasm-tools
Installation can be confirmed with:
$ wasm-tools --version
Subcommands can be explored with:
$ wasm-tools help
Examples
Basic validation/printing/parsing:
# Validate a WebAssembly file
# Validate a WebAssembly module in the text format, automatically converting to
# binary.
# Validate a WebAssembly file enabling an off-by-default feature
# Validate a WebAssembly file with a default-enabled feature disabled
# Print the text format of a module to stdout
# Convert a binary module to text
# Convert a text module to binary
Simple mutation as well as piping commands together:
# Mutate a WebAssembly module and print its text representation to stdout
# Mutate a WebAssembly module with a non-default seed and validate that the
# output is a valid module.
|
# Demangle Rust/C++ symbol names in the `name` section, strip all other custom
# sections, and then print out what binary sections remain.
| |
Working with components:
# Print the WIT interface of a component
# Convert WIT text files to a binary-encoded WIT package, printing the result to
# stdout
# Convert a WIT document to JSON
# Round trip WIT through the binary-encoded format to stdout.
|
# Convert a core WebAssembly binary into a component. Note that this requires
# WIT metadata having previously been embedded in the core wasm module.
# Convert a core WebAssembly binary which uses WASI to a component.
CLI Conventions
There are a few conventions that all CLI commands adhere to:
- All subcommands print "short help" with
-hand "long help" with--help. - Input is by default read from stdin if no file input is specified (when applicable).
- Output is by default sent to stdout if a
-oor--outputflag is not provided. Binary WebAssembly is not printed to a tty by default, however. - Commands which output WebAssembly binaries all support a
-tor--watflag to generate the WebAssembly text format instead. - A
-vor--verboseflag can be passed to enable log messages throughout the tooling. Verbosity can be turned up by passing the flag multiple times such as-vvv. - Color in error messages and console output is enabled by default for TTY based
outputs and can be configured with a
--colorargument.
Tools included
The wasm-tools binary internally contains a number of subcommands for working
with wasm modules and component. Many subcommands also come with Rust crates
that can be use programmatically as well:
| CLI | Rust Crate | Playground | Description |
|---|---|---|---|
wasm-tools validate |
wasmparser | Validate a WebAssembly file | |
wasm-tools parse |
wat and wast | parse | Translate the WebAssembly text format to binary |
wasm-tools print |
wasmprinter | Translate the WebAssembly binary format to text | |
wasm-tools smith |
wasm-smith | Generate a valid WebAssembly module from an input seed | |
wasm-tools mutate |
wasm-mutate | Mutate an input wasm file into a new valid wasm file | |
wasm-tools shrink |
wasm-shrink | Shrink a wasm file while preserving a predicate | |
wasm-tools dump |
Print debugging information about the binary format | ||
wasm-tools objdump |
Print debugging information about section headers | ||
wasm-tools strip |
Remove custom sections from a WebAssembly file | ||
wasm-tools demangle |
Demangle Rust and C++ symbol names in the name section |
||
wasm-tools compose |
wasm-compose | Compose wasm components together (deprecated) | |
wasm-tools component new |
wit-component | Create a component from a core wasm binary | |
wasm-tools component wit |
Extract a *.wit interface from a component |
||
wasm-tools component embed |
Embed a component-type custom section in a core wasm binary |
||
wasm-tools component unbundle |
Extract core wasm modules from a component | ||
wasm-tools metadata show |
wasm-metadata | Show name and producer metadata in a component or module | |
wasm-tools metadata add |
Add name or producer metadata to a component or module | ||
wasm-tools addr2line |
Translate wasm offsets to filename/line numbers with DWARF | ||
wasm-tools completion |
Generate shell completion scripts for wasm-tools |
||
wasm-tools json-from-wast |
Convert a *.wast file into JSON commands |
||
wasm-tools wast |
Validate the structure of a *.wast file |
The wasm-tools CLI contains useful tools for debugging WebAssembly modules and
components. The various subcommands all have --help explainer texts to
describe more about their functionality as well.
WebAssembly proposals
This repository strives to implement any standardized proposal to WebAssembly. All proposals that are Stage 4+ are enabled by default in validation. Support in the text format is always enabled at all times for all proposals.
Currently implemented proposals in this repository that are stage 4+ are:
- annotations
- branch-hinting
- bulk-memory
- component-model (note this is an exception, it's not stage4+ but is on-by-default)
- exception-handling
- extended-const
- extended-name-section
(note this is not phase 4 but
wastdoes not have the concept of features) - function-references
- gc
- memory64
- multi-memory
- multi-value
- mutable-global
- reference-types
- relaxed-simd
- saturating-float-to-int
- sign-extension-ops
- simd
- tail-call
- threads
- wat-numeric-values
(note this is not phase 4 but
wastdoes not have the concept of features)
These proposals are implemented but have not yet reached stage 4. This means they are disabled by default in validation and their implementation may change over time as the proposal evolves. Additionally the proposal may also have changed since these proposals were implemented, so there may be a mismatch too.
Libraries
As mentioned above many of the tools of the wasm-tools CLI have libraries
implemented in this repository as well. These libraries are:
wasmparser- a library to parse WebAssembly binarieswat- a library to parse the WebAssembly text formatwast- likewat, except provides an ASTwasmprinter- prints WebAssembly binaries in their string formwasm-mutate- a WebAssembly test case mutatorwasm-shrink- a WebAssembly test case shrinkerwasm-smith- a WebAssembly test case generatorwasm-encoder- a crate to generate a binary WebAssembly modulewit-parser- a crate to parse and manage*.witfiles and interfaces.wit-encoder- a crate to generate*.witfiles and interfaces.wit-component- a crate to create components from core wasm modules.wit-smith- a*.wittest case generator.wasm-metadata- a crate to read and manipulate WebAssembly metadata
It's recommended to use the libraries directly rather than the CLI tooling when embedding into a separate project.
C/C++ bindings
Using the CMakeLists.txt in crates/c-api, wasm-tools can be used from the
wasm-tools.h header. Note that these
bindings do not comprehensively cover all the functionality of this repository
at this time, but please feel free to contribute more if you find functions
useful!
Versioning and Releases
This repository has both a CLI and a suite of crates that is published to crates.io (Rust's package manager). The versioning scheme used by this repository looks like:
wasm-tools- the CLI follows the versioning pattern of1.X.Y. FrequentlyYis 0 andXis bumped as part of a release for this repository.wat- this Rust crate is versioned at1.X.Yas well and matches thewasm-toolsversion.wast- this Rust crate is versioned asX.0.Y. TheXhere matches theXin1.X.Yofwasm-tools.- All other crates - all other crates in this repository are versioned at
0.X.YwhereXmatches the1.X.Yofwasm-tools.
Note that the Y of all the versions above will also match for any release of
this repository. This versioning scheme is intended to reflect the stable nature
of the CLI and the wat crate in terms of API stability. Other crates, however,
all receive a major version bump that are not automatically considered API
compatible on all releases. This reflects how WebAssembly itself is an evolving
standard which is not an unchanging foundation. All of the crates in this
repository are suitable for "production use" but be aware that API stability is
not guaranteed over time. If you have difficulty upgrading versions please feel
free to file an issue and we can help out.
Also, this repository does not currently have a strict release cadence. Releases are done on an as-needed basis. If you'd like a release done please feel free to reach out on Zulip, file an issue, leave a comment on a PR, or otherwise contact a maintainer.
For maintainers, the release process looks like:
- Go to this link
- Click on "Run workflow" in the UI.
- Use the default
bumpargument and hit "Run workflow" - Wait for a PR to be created by CI. You can watch the "Actions" tab for if things go wrong.
- When the PR opens, close it then reopen it. Don't ask questions.
- Review the PR, approve it, then queue it for merge.
That should be it, but be sure to keep an eye on CI in case anything goes wrong.
Patch Release Process
Patch releases aren't too frequent so the process is a bit more involved at this time. The basic idea is the same though as a normal release:
- Determine that you're going to make a patch release for the release of
wasm-toolsversion1.N.0. - If
Nis the latest version onmain, or basically if a major release hasn't happened sinceN, then land changes onmainfirst. Then go to this link and run the workflow against themainbranch withbump-patchas an argument. Double-check all changes from thev1.N.0tag to ensure that no breaking changes in any crate have landed. - If
Nis not the latest version onmain, then create a new branch in the repository namedrelease-Nstarting from thev1.N.0tag. Next land changes as PRs against this branch, and note that CI may not have been run in awhile so it may need some fixes. Then run the same workflow as above against therelease-Nbranch with thebump-patchargument. Again double-check that no breaking changes have been made.
Basically a release-N may need to be manually created if the main branch has
moved beyond N. After that though it should work basically the same where a
workflow is run and a PR is merged and that's all that's necessary.
Contributing
See CONTRIBUTING.md for more information about contributing to this repository.
License
This project is triple licenced under the Apache 2/ Apache 2 with LLVM exceptions/ MIT licences. The reasoning for this is:
- Apache 2/ MIT is common in the rust ecosystem.
- Apache 2/ MIT is used in the rust compiler, and some of this code may be migrated there.
- Some of this code may be used in compiler output, and the Apache 2 with LLVM exceptions licence is useful for this.
For more details see
Contribution
Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in this project by you, as defined in the Apache 2/ Apache 2 with LLVM exceptions/ MIT licenses, shall be licensed as above, without any additional terms or conditions.