Skip to main content

Crate faucet_lineage

Crate faucet_lineage 

Source
Expand description

OpenLineage event emission for faucet-stream pipelines.

Emits OpenLineage RunEvents (START/RUNNING/COMPLETE/ABORT/FAIL) for a pipeline run to an HTTP, file, or Kafka backend. Wired by the faucet CLI; the types here are also usable directly by library callers.

OpenLineage spec version: 2.0.2 (see event::OL_SCHEMA_URL).

Re-exports§

pub use column::ColumnLineage;
pub use column::ColumnOp;
pub use column::derive as derive_column_lineage;
pub use config::EmitOn;
pub use config::HttpAuth;
pub use config::LineageConfig;
pub use config::ParentJob;
pub use config::Transport;
pub use emitter::LineageEmitter;
pub use event::EventType;
pub use event::RunEvent;
pub use lifecycle::DatasetRef;
pub use lifecycle::InferredSchema;
pub use lifecycle::RunLifecycle;
pub use sampling::SampleState;
pub use sampling::SamplingSink;
pub use sampling::SamplingSource;

Modules§

column
Deterministic column-level lineage from a declarative transform chain.
config
User-facing lineage: configuration types.
emitter
Builds OpenLineage events from a RunLifecycle and dispatches them via the configured transport. Emission failures NEVER fail the pipeline run — they are logged and counted, then dropped.
event
OpenLineage RunEvent object model (serde-faithful subset, OL 2.0.2).
lifecycle
Per-invocation lineage context the executor fills and hands to the emitter.
sampling
Sink/source wrappers that sample records for schema inference and count throughput for RUNNING heartbeats. Installed only when the corresponding lineage facets/events are enabled, so they add zero overhead otherwise.
transport
Event transports.

Functions§

schemars_schema
JSON Schema for the lineage: config block (for faucet schema lineage).