Expand description
OpenLineage event emission for faucet-stream pipelines.
Emits OpenLineage RunEvents (START/RUNNING/COMPLETE/ABORT/FAIL) for a
pipeline run to an HTTP, file, or Kafka backend. Wired by the faucet CLI;
the types here are also usable directly by library callers.
OpenLineage spec version: 2.0.2 (see event::OL_SCHEMA_URL).
Re-exports§
pub use column::ColumnLineage;pub use column::ColumnOp;pub use column::derive as derive_column_lineage;pub use config::EmitOn;pub use config::HttpAuth;pub use config::LineageConfig;pub use config::ParentJob;pub use config::Transport;pub use emitter::LineageEmitter;pub use event::EventType;pub use event::RunEvent;pub use lifecycle::DatasetRef;pub use lifecycle::InferredSchema;pub use lifecycle::RunLifecycle;pub use sampling::SampleState;pub use sampling::SamplingSink;pub use sampling::SamplingSource;
Modules§
- column
- Deterministic column-level lineage from a declarative transform chain.
- config
- User-facing
lineage:configuration types. - emitter
- Builds OpenLineage events from a
RunLifecycleand dispatches them via the configured transport. Emission failures NEVER fail the pipeline run — they are logged and counted, then dropped. - event
- OpenLineage
RunEventobject model (serde-faithful subset, OL 2.0.2). - lifecycle
- Per-invocation lineage context the executor fills and hands to the emitter.
- sampling
- Sink/source wrappers that sample records for schema inference and count throughput for RUNNING heartbeats. Installed only when the corresponding lineage facets/events are enabled, so they add zero overhead otherwise.
- transport
- Event transports.
Functions§
- schemars_
schema - JSON Schema for the
lineage:config block (forfaucet schema lineage).