WARNING: Be careful with your access tokens.
cargo-sideload downloads crates from an alternative registry and stores them in your Cargo cache
as if they were downloaded by Cargo directly. It makes a simple GET request with whatever headers you tell it to use.
The primary use case is downloading crates from an authenticated endpoint, a feature that Cargo does not currently support.
It is meant to be a temporary workaround until this feature is added to Cargo.
Cargo's documentation has lots of useful information about working with alternative registries.
Installation
cargo install cargo-sideload
First run
- Add your alternate registry to
~/.cargo/config.toml.[] = { = "https://github.com/picklenerd/test_registry" } - Add
registry = "[registry-name]"to any dependencies that use the registry.= { = "1.0", = "test_registry" } - Run
cargo sideload fetch --registry=[registry-name]in your crate's root.- Use the
--headersargument if your download endpoint requires authentication or other headers.
Header format:[Header-Name]: [Header Value].
- Use the
- Your crates are now in the local cargo cache.
cargowill use the local copies rather than attempt to download them.
Subsequent runs
- If alternate registry dependencies have changed
- Run
cargo update -p [crate-names]to update yourCargo.lockfile. - Run
cargo sideload fetch --registry=[registry-name]to download updated dependencies.
- Run
- If alternate registry dependences have not changed, you don't have to do anything.
More Info
cargo sideload --help
Config file
A config file can be used to set a default registry and to associate headers with specific registries.
This allows you to run commands like cargo sideload fetch without providing --registry and --headers arguments.
To use a config, create the file ~/.config/cargo-sideload/config.toml. All of the available config options are
listed in the example below.
= "test_registry"
[]
= [ "Authorization: Blah abcd1234" ]
[]
= [
"PRIVATE-KEY: abcdef",
"Some-Other-Header: And its value",
]
Extra Tools
cargo-sideload comes with a few extra tools for working with private registries. These extra subcommands are provided
because existing tools don't always work with private registries or authenticated download endpoints.
cargo sideload list [crate-name] will list some information about each available version of the specified crate.
Yanked versions are not included in the result. Using --latest will print the info for the latest version of the crate,
while --latest-version will only return the latest version number.
cargo sideload outdated --registry=[registry-name] will list all dependencies with newer versions available
in the specified registry. --registry is optional if you have a default registry set. A list of crates to check
can be specified with --packages.
Troubleshooting
If you type your authentication header wrong, you might end up in a situation where your downloaded .crate file
is actually the HTML for a login page, or some similar situation. cargo-sideload will tell Cargo to unpack your
.crate files after downloading them. If unpacking fails, you'll get an error and the downloaded file will be deleted.
If you find yourself in a situation where you want to force a new download, you can use the --force option.
This will delete the existing file and download a new copy.
cargo-sideload uses the pretty_env_logger crate to print debug info. Use RUST_LOG=debug cargo sideload fetch
to see the details of the HTTP request and response for your file downloads. You will also see logs from Cargo and
any other dependencies based on the value of RUST_LOG. See the env_logger
documentation for more details.
If you try to run a normal Cargo command with a corrupt or otherwise invalid crate,
you'll get an error message something like the one below. If that happens, you most likely need to troubleshoot
your download endpoint or your headers. Enabling logs and using the --force option can make this much easier.
error: failed to download `my_lib v0.1.0 (registry `https://github.com/picklenerd/test_registry`)`
Caused by:
unable to get packages from source
Caused by:
failed to unpack package `my_lib v0.1.0 (registry `https://github.com/picklenerd/test_registry`)`
Caused by:
failed to iterate over archive
Caused by:
failed to fill whole buffer