Skip to main content

Module io

Module io 

Source
Expand description

Positional file I/O.

The engine never seeks. Every read and write carries its own absolute offset (pread/pwrite), which is what allows N workers to touch one file concurrently without a lock and without a shared cursor. It is also why a 100 GB file costs the same resident memory as a 100 MB one: nothing is ever buffered beyond the chunks currently in flight.

Re-exports§

pub use reader::ChunkReader;
pub use writer::part_path_for;
pub use writer::FileWriters;
pub use writer::WriteHandle;

Modules§

reader
Source-side reads.
writer
Destination-side writes.