fv_streams_runtime/lib.rs
1//! THE DATAFLOW RUNTIME of FusionVault Streams: a pipeline as tasks on OS threads connected by
2//! bounded in-memory edges that carry Arrow batches and the two control signals — watermarks and
3//! checkpoint barriers — in band; the coordinator's epochs; the cross-worker exchange (bridges over
4//! `fv-streams-exchange` links, Arrow IPC frames); placement of a graph over a member set; the
5//! cluster handshake and the leader's control channel. Sources, sinks and operators are the
6//! contract crate's traits: the runtime runs whatever it is handed and never knows a connector,
7//! an operator's algebra or a hash function (the shuffle's [`dataflow::Hasher`] is the planner's).
8
9/// Every Rust code block in the README is compiled and run as a doctest.
10#[cfg(doctest)]
11#[doc = include_str!("../README.md")]
12pub struct ReadmeDoctests;
13
14pub mod cluster;
15pub mod dataflow;
16mod exchange_bridge;
17mod exchange_codec;
18pub mod placement;