Struct SourceConfig 

pub struct SourceConfig {
    pub kind: SourceKind,
    pub location: String,
}

Fields

kind: SourceKind

location: String

Either a local filesystem path or an s3://bucket/key URL.

Implementations

impl SourceConfig

pub fn is_s3(&self) -> bool

pub fn has_glob(&self) -> bool

True when the location already contains a glob metacharacter (*, ?, or [).

pub fn s3_recursive_parquet_glob(&self) -> String

Location to hand to a backend that needs an explicit parquet glob (DuckDB). When the location is a plain S3 prefix with no glob, append a recursive **/*.parquet so DuckDB lists the prefix the same way DataFusion’s object-store listing does. Globbed or non-S3 locations are returned unchanged.

pub fn s3_bucket(&self) -> Result<(&str, &str), AppError>

Returns (bucket, key_prefix_or_empty) for an s3://… location.

Trait Implementations

impl Clone for SourceConfig

fn clone(&self) -> SourceConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SourceConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for SourceConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.