Skip to main content

Crate faucet_source_parquet

Crate faucet_source_parquet 

Source
Expand description

Apache Parquet source connector for the faucet-stream ecosystem.

Reads Parquet files from local paths, glob patterns, or S3 and yields each row as a serde_json::Value. Built on the parquet + arrow crates for vectorised, streaming reads — no whole-file buffering.

See the crate-level README for configuration examples.

Re-exports§

pub use config::ParquetLocation;
pub use config::ParquetS3Config;
pub use config::ParquetSourceConfig;
pub use convert::record_batch_to_json;
pub use stream::ParquetSource;

Modules§

config
Parquet source configuration.
convert
Arrow RecordBatchserde_json::Value conversion.
stream
Parquet source stream executor.

Enums§

FaucetError
All possible errors returned by faucet-stream.

Traits§

Source
A source fetches records from an external system.