Crate aqueducts_schemas 

Aqueducts Schemas

This crate contains all the schema definitions and configuration types used throughout the aqueducts ecosystem. By centralizing these types here, we avoid circular dependencies between core, delta, ODBC, and other provider crates.

Re-exports

pub use data_types::DataType;

pub use data_types::Field;

pub use data_types::IntervalUnit;

pub use data_types::TimeUnit;

pub use data_types::UnionMode;

pub use destinations::CsvDestinationOptions;

pub use destinations::CsvDestinationOptionsBuilder;

pub use destinations::DeltaWriteMode;

pub use destinations::DestinationFileType;

pub use destinations::ReplaceCondition;

pub use destinations::DeltaDestination;

pub use destinations::Destination;

pub use destinations::FileDestination;

pub use destinations::InMemoryDestination;

pub use destinations::OdbcDestination;

pub use destinations::DeltaDestinationBuilder;

pub use destinations::FileDestinationBuilder;

pub use destinations::InMemoryDestinationBuilder;

pub use destinations::OdbcDestinationBuilder;

pub use location::Location;

pub use sources::CsvSourceOptions;

pub use sources::JsonSourceOptions;

pub use sources::ParquetSourceOptions;

pub use sources::SourceFileType;

pub use sources::CsvSourceOptionsBuilder;

pub use sources::JsonSourceOptionsBuilder;

pub use sources::ParquetSourceOptionsBuilder;

pub use sources::DeltaSource;

pub use sources::DirSource;

pub use sources::FileSource;

pub use sources::InMemorySource;

pub use sources::OdbcSource;

pub use sources::Source;

pub use sources::DeltaSourceBuilder;

pub use sources::DirSourceBuilder;

pub use sources::FileSourceBuilder;

pub use sources::InMemorySourceBuilder;

pub use sources::OdbcSourceBuilder;

pub use progress::OutputType;

pub use progress::ProgressEvent;

pub use stages::Stage;

pub use stages::StageBuilder;

Modules

data_types

Custom schema types that work universally across all aqueducts backends.

destinations

Destination configuration types and schemas.

location

Location type that handles both file paths and URLs

progress

Progress event types for tracking pipeline execution

sources

Source configuration types and schemas.

stages

Stage configuration types and schemas.

Structs

Aqueduct

Definition for an Aqueduct data pipeline.

AqueductBuilder

Use builder syntax to set the inputs and finish with build().