spate-core 0.2.0

Engine for the Spate framework: records, operator chains, source/sink abstractions, checkpointing, backpressure, config, metrics, and the pipeline runtime. Applications should depend on the `spate` facade crate instead.
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
# spate-core

The engine of the [Spate](https://github.com/spate-etl/spate)
framework: records and acknowledgement handles, the operator-chain builder,
the source/sink abstractions, checkpointing (per-partition contiguity
watermarks), backpressure, YAML configuration with opaque per-connector
sections, metrics/admin/telemetry, and the pipeline runtime (pinned driver
threads, controller, graceful drain).

Applications should depend on the [`spate`](https://crates.io/crates/spate)
facade crate instead; connector authors implement
`source::{Source, SourceLane}` and `sink::{RowEncoder, ShardWriter}` from
here. The properties the engine is arranged around are documented under
[Invariants](https://spate.kainth.dev/docs/INVARIANTS), and the decisions
behind them under [Decisions](https://spate.kainth.dev/docs/adr/).