spate-core 0.1.0

Engine for the Spate framework: records, operator chains, source/sink abstractions, checkpointing, backpressure, config, metrics, and the pipeline runtime. Applications should depend on the `spate` facade crate instead.
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
13
14
# spate-core

The engine of the [Spate](https://github.com/spate-etl/spate)
framework: records and acknowledgement handles, the operator-chain builder,
the source/sink abstractions, checkpointing (per-partition contiguity
watermarks), backpressure, YAML configuration with opaque per-connector
sections, metrics/admin/telemetry, and the pipeline runtime (pinned driver
threads, controller, graceful drain).

Applications should depend on the [`spate`](https://crates.io/crates/spate)
facade crate instead; connector authors implement
`source::{Source, SourceLane}` and `sink::{RowEncoder, ShardWriter}` from
here. The architecture and its invariants are documented in the
repository's `docs/DESIGN.md`.