flusso-sources-core 0.1.1

Change-capture and document-builder abstractions for flusso sources.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49

//! The source abstractions for `flusso`.
//!
//! A source has two **independent** responsibilities, each its own module.
//! Neither module references the other; the engine is the only thing that
//! bridges them.
//!
//! - [`cdc`] — *what changed?* A pluggable change-capture mechanism that yields
//!   a stream of thin [`Change`](cdc::Change)s and confirms progress via an
//!   [`Ack`](cdc::Ack). Logical replication (WAL) is the first mechanism;
//!   polling or triggers can follow.
//! - [`document`] — *what to build?* Turns a changed row (named by table and
//!   key) into the target documents it affects, and assembles each one.
//!
//! Alongside them, [`validate_indexes`] is the source-independent
//! half of a check every source can offer: a self-describing schema states its
//! own types, so the mapping is derived without a database, and a reachable
//! database is used only to confirm the declared types and nullability match
//! the real columns. A source supplies only the one store-specific piece — a
//! [`Catalog`] over its column types.
//!
//! Both build on two shared, mechanism-neutral primitives that belong to
//! neither concern:
//!
//! - [`RowKey`] — a row's primary key as ordered column/value pairs.
//! - [`SnapshotTable`] — a schema-qualified table the engine asks a mechanism
//!   to snapshot when seeding an index.
//! - [`SourceSpec`] — the source's own view of what to build (the enabled
//!   indexes and their schemas), a subset of the top-level config translated by
//!   the composition root so the backend never sees `Config`.
//! - [`SourceError`] / [`Result`] — the common error type.
//!
//! Keeping the two abstractions apart means a deployment can mix any change
//! mechanism with any document builder, and either can be implemented, tested,
//! or replaced without touching the other.

mod error;
mod row_key;
mod snapshot_table;
mod spec;
mod validation;

pub mod cdc;
pub mod document;

pub use error::*;
pub use row_key::*;
pub use snapshot_table::*;
pub use spec::*;
pub use validation::*;