Crate warm_fs

Source
Expand description

A File system warmer

Cloud providers tent to restore volumes from snapshots in a cold state:

For volumes that were created from snapshots, the storage blocks must be pulled down from Amazon S3 and written to the volume before you can access them. This preliminary action takes time and can cause a significant increase in the latency of I/O operations the first time each block is accessed (source).

It has methods to estimates total size of particular folder and then recursively read files in a thread pool.

It implements Iterator giving an access to the warming process intermediate state. Refer to cli example for progress bar implementation.

Structsยง

  • Iterator over the size estimation / file reading bytes
  • The warmer