1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333
#![allow(clippy::needless_doctest_main)]
/*!
[](https://crates.io/crates/hot-lib-reloader)
[](https://docs.rs/hot-lib-reloader)
[](https://github.com/rksm/hot-lib-reloader-rs/actions/workflows/ci.yml)
[](/LICENSE.md)

`hot-lib-reloader` is a development tool that allows you to reload functions of a running Rust program.
This allows to do "live programming" where you modify code and immediately see the effects in your running program.
This is build around the [libloading crate](https://crates.io/crates/libloading) and will require you to put code you want to hot-reload inside a Rust library (dylib). For a detailed discussion about the idea and implementation see [this blog post](https://robert.kra.hn/posts/hot-reloading-rust).
# Table of contents:
- [Usage](#usage)
- [Example project setup](#example-project-setup)
- [Executable](#executable)
- [Library](#library)
- [Running it](#running-it)
- [Usage tips](#usage-tips)
- [Know the limitations](#know-the-limitations)
- [No signature changes](#no-signature-changes)
- [Type changes require some care](#type-changes-require-some-care)
- [Hot-reloadable functions cannot be generic](#hot-reloadable-functions-cannot-be-generic)
- [Global state in reloadable code](#global-state-in-reloadable-code)
- [Rust nightly](#rust-nightly)
- [Use feature flags to switch between hot-reload and static code](#use-feature-flags-to-switch-between-hot-reload-and-static-code)
- [Use serialization or generic values for changing types](#use-serialization-or-generic-values-for-changing-types)
- [Use a hot-reload friendly app structure](#use-a-hot-reload-friendly-app-structure)
- [Use multiple libraries](#use-multiple-libraries)
- [Code-completion with rust-analyzer](#code-completion-with-rust-analyzer)
- [Examples](#examples)
- [Known issues](#known-issues)
- [tracing crate](#tracing-crate)
# Usage
To quicky generate a new project supporting hot-reload you can use a [cargo generate](https://cargo-generate.github.io/cargo-generate/) template: `cargo generate rksm/rust-hot-reload`.
## Example project setup
Assuming you use a workspace project with the following layout:
```output
├── Cargo.toml
└── src
│ └── main.rs
└── lib
├── Cargo.toml
└── src
└── lib.rs
```
### Executable
Setup the workspace with a root project named `bin` in `./Cargo.toml`:
```toml
[workspace]
resolver = "2"
members = ["lib"]
[package]
name = "bin"
version = "0.1.0"
edition = "2021"
[dependencies]
hot-lib-reloader = "^0.5"
lib = { path = "lib" }
```
In `./src/main.rs` define a sub-module which wraps the functions exported by the library:
```ignore
// The value of `dylib = "..."` should be the library containing the hot-reloadable functions
// It should normally be the crate name of your sub-crate.
#[hot_lib_reloader::hot_module(dylib = "lib")]
mod hot_lib {
// Reads public no_mangle functions from lib.rs and generates hot-reloadable
// wrapper functions with the same signature inside this module.
hot_functions_from_file!("../lib/src/lib.rs");
// Because we generate functions with the exact same signatures,
// we need to import types used
pub use lib::State;
}
fn main() {
let mut state = hot_lib::State { counter: 0 };
// Running in a loop so you can modify the code and see the effects
loop {
hot_lib::do_stuff(&mut state);
std::thread::sleep(std::time::Duration::from_secs(1));
}
}
```
### Library
The library should expose functions. It should set the crate type `dylib` in `./lib/Cargo.toml`:
```toml
[package]
name = "lib"
version = "0.1.0"
edition = "2021"
[lib]
crate-type = ["rlib", "dylib"]
```
The functions you want to be reloadable should be public and have the `#[no_mangle]` attribute. Note that you can define other function that are not supposed to change without `no_mangle` and you will be able to use those alongside the other functions.
```
pub struct State {
pub counter: usize,
}
#[no_mangle]
pub fn do_stuff(state: &mut State) {
state.counter += 1;
println!("doing stuff in iteration {}", state.counter);
}
```
### Running it
1. Start compilation of the library: `cargo watch -w lib -x 'build -p lib'`
2. In another terminal run the executable: `cargo run`
Now change for example the print statement in `lib/lib.rs` and see the effect on the runtime.
In addition, using a tool like [cargo runcc](https://crates.io/crates/runcc) is recommended. This allows to run both the lib build and the application in one go.
# Usage tips
## Know the limitations
Reloading code from dynamic libraries comes with a number of caveats which are discussed in some detail [here](https://robert.kra.hn/posts/hot-reloading-rust/#caveats-and-asterisks).
### No signature changes
When the signature of a hot-reloadable function changes, the parameter and result types the executable expects differ from what the library provides. In that case you'll likely see a crash.
### Type changes require some care
Types of structs and enums that are used in both the executable and library cannot be freely changed. If the layout of types differs you run into undefined behavior which will likely result in a crash.
See [use serialization](#use-serialization-or-generic-values-for-changing-types) for a way around it.
### Hot-reloadable functions cannot be generic
Since `#[no_mangle]` does not support generics, generic functions can't be named / found in the library.
### Global state in reloadable code
If your hot-reload library contains global state (or depends on a library that does), you will need to re-initialize it after reload. This can be a problem with libraries that hide the global state from the user. If you need to use global state, keep it inside the executable and pass it into the reloadable functions if possible.
### Rust nightly
You currently need to use Rust nightly to run hot-reloadable code. The reason for that is that we currently need [the `proc_macro::Span` feature](https://github.com/rust-lang/rust/issues/54725). We are looking into a solution that works on stable.
## Use feature flags to switch between hot-reload and static code
See the [reload-feature example](https://github.com/rksm/hot-lib-reloader-rs/tree/master/examples/reload-feature) for a complete project.
Cargo allows to specify optional dependencies and conditional compilation through feature flags.
When you define a feature like this
```toml
[features]
default = []
reload = ["dep:hot-lib-reloader"]
[dependencies]
hot-lib-reloader = { version = "^0.5", optional = true }
```
and then conditionally use either the normal or the hot module in the code calling the reloadable functions you can seamlessly switch between a static and hot-reloadable version of your application:
```ignore
#[cfg(feature = "reload")]
use hot_lib::*;
#[cfg(not(feature = "reload"))]
use lib::*;
#[cfg(feature = "reload")]
#[hot_lib_reloader::hot_module(dylib = "lib")]
mod hot_lib { /*...*/ }
```
To run the static version just use `cargo run` the hot reloadable variant with `cargo run --features reload`.
## Use serialization or generic values for changing types
If you want to iterate on state while developing you have the option to serialize it. If you use a generic value representation such as [serde_json::Value](https://docs.rs/serde_json/latest/serde_json/value/enum.Value.html), you don't need string or binary formats and typically don't even need to clone anything.
Here is an example where we crate a state container that has an inner `serde_json::Value`:
```ignore
#[hot_lib_reloader::hot_module(dylib = "lib")]
mod hot_lib {
pub use lib::State;
hot_functions_from_file!("../lib/src/lib.rs");
}
fn main() {
let mut state = hot_lib::State {
inner: serde_json::json!(null),
};
loop {
state = hot_lib::step(state);
std::thread::sleep(std::time::Duration::from_secs(1));
}
}
```
In the library we are now able to change the value and type layout of `InnerState` as we wish:
```ignore
#[derive(Debug)]
pub struct State {
pub inner: serde_json::Value,
}
#[derive(serde::Deserialize, serde::Serialize)]
struct InnerState {}
#[no_mangle]
pub fn step(state: State) -> State {
let inner: InnerState = serde_json::from_value(state.inner).unwrap_or(InnerState {});
// You can modify the InnerState layout freely and state.inner value here freely!
State {
inner: serde_json::to_value(inner).unwrap(),
}
}
```
## Use a hot-reload friendly app structure
Whether or not hot-reload is easy to use depends on how you architect your app. In particular, the ["functional core, imparative shell" pattern](https://www.destroyallsoftware.com/screencasts/catalog/functional-core-imperative-shell) makes it easy to split state and behavior and works well with `hot-lib-reloader`
For example, for a simple game where you have the main loop in your control, setting up the outer state in the main function and then passing it into a `fn update(state: &mut State)` and a `fn render(state: &State)` is a straightforward way to get two hot-reloadable functions.
But even when using a framework that takes control, chances are that there are ways to have it call hot-reloadable code. The [bevy example](https://github.com/rksm/hot-lib-reloader-rs/tree/master/examples/bevy) where system functions can be made hot-reloadable, shows how this can work.
## Code-completion with rust-analyzer
Functions that get injected with automatic code generation that happens with `hot_functions_from_file!("path/to/file.rs");` won't be picked up by rust-analyzer and thus you don't have auto-completion for them.
There is a different syntax available that allows you to define reloadable functions inline so that they get picked up by rust-analyzer:
```ignore
#[hot_lib_reloader::hot_module(dylib = "lib")]
mod hot_lib {
#[hot_functions]
extern "Rust" {
pub fn do_stuff();
}
}
```
## Debugging
If your `hot_module` gives you a strange compilation error, try `cargo expand` to see what code is generated.
# Examples
Examples can be found at [rksm/hot-lib-reloader-rs/examples](https://github.com/rksm/hot-lib-reloader-rs/tree/master/examples).
- [minimal](https://github.com/rksm/hot-lib-reloader-rs/tree/master/examples/minimal): Bare-bones setup.
- [reload-feature](https://github.com/rksm/hot-lib-reloader-rs/tree/master/examples/reload-feature): Use a feature to switch between dynamic and static version.
- [serialized-state](https://github.com/rksm/hot-lib-reloader-rs/tree/master/examples/serialized-state): Shows an option to allow to modify types and state freely.
- [bevy](https://github.com/rksm/hot-lib-reloader-rs/tree/master/examples/bevy): Shows how to hot-reload bevy systems.
# Known issues
## tracing crate
When used with the `tracing` crate multiple issues can occur:
- When `tracing` is used in the library that is reloaded the app sometimes crashes with `Attempted to register a DefaultCallsite that already exists!`
- When used in combination with bevy, `commands.insert(component)` operations stop to work after a reload, likely because of internal state getting messed up.
If you can, don't use `hot-lib-reloader` in combination with `tracing`.
# License
[MIT](https://github.com/rksm/hot-lib-reloader-rs/blob/hot-module/LICENSE)
*/
mod error;
mod lib_reloader;
pub use error::HotReloaderError;
pub use hot_lib_reloader_macro::{define_lib_reloader, hot_module};
pub use lib_reloader::{ChangedEvent, LibReloader};