Crate faucet_cli 

faucet-cli

A config-driven runner for faucet-stream pipelines. Define a source, optional transforms, a sink, and (optionally) a state store in a YAML or JSON file, then run it with the faucet binary — no Rust code required.

The library half of this crate exposes the same building blocks the binary uses (config parsing, env interpolation, the connector registry) so that integrations and tests can reuse them.

Re-exports

pub use error::CliError;

pub use error::CliResult;

Modules

auth_catalog

The top-level auth: provider catalog.

cli

Argument parser shared by main.rs and the integration tests.

commands

Subcommand implementations. Each module owns its run(...) entry point and stays free of clap so the integration tests can drive it directly.

config

Parsed pipeline.yaml / pipeline.json schema (matrix-aware).

env_config

Build a PipelineConfig from a snapshot of FAUCET_* environment variables.

env_loader

Resolve a .env file path and auto-discover a pipeline config file.

error

CLI-level error type. Wraps every failure mode the binary surfaces so main() can render a single, user-readable line per failure.

executor

Run a list of ExpandedNodes under a bounded-concurrency executor.

expand

Expand a parsed PipelineConfig into a flat list of ExpandedNodes ready for the executor to run.

init_template

Schema-driven YAML template emitter for faucet init.

interpolate

Two-stage interpolation for pipeline configs.

merge

Deep-merge of serde_json::Value for matrix-row overrides.

obs

Shared observability setup (Prometheus + tracing) used by run and schedule. install_observability is idempotent, so calling this once per process is safe even though main.rs already installed a basic subscriber.

registry

Feature-gated dispatch from a string type to a concrete connector.

scheduleschedule

faucet schedule — built-in cron scheduler.

secrets

Secrets-manager interpolation for the config layer (#125).

serveserve

faucet serve — HTTP control plane (#127). Runs pipeline configs submitted over HTTP, reusing executor::run_expanded. Feature-gated on serve; structured like cli/src/schedule/. See docs/superpowers/specs/2026-05-30-faucet-serve-design.md.

state

Build a StateStore from a (kind, config) pair, with feature-gated backends for Redis and PostgreSQL.

transforms

Compile YAML/JSON transform declarations into TransformStage values.

Functions

run_from_yaml_str

Convenience entry point for integration tests and custom hosts: parse a YAML config string, expand the matrix, and run all rows.