Struct ScanRequest 

pub struct ScanRequest {
    pub project_dir: PathBuf,
    pub scan_path: String,
    pub format: SourceFormat,
    pub paths: Vec<String>,
    pub toml_rows_key: Option<String>,
    pub partition_by: Vec<String>,
    pub require_partitions: HashMap<String, String>,
    pub path_glob: Vec<String>,
    pub inject_source_path: bool,
    pub roots: HashMap<String, String>,
    pub protobuf_max_payload_bytes: u64,
}

Scan request derived from staging frontmatter + project root.

Fields

project_dir: PathBuf

scan_path: String

format: SourceFormat

paths: Vec<String>

jshift / projection paths (JSONL selective extract).

toml_rows_key: Option<String>

TOML array-of-tables key (optional).

partition_by: Vec<String>

Hive-style partition keys to inject as Utf8 columns from the file path.

require_partitions: HashMap<String, String>

Keep only files whose hive path matches these partition values.

path_glob: Vec<String>

Filename / relative globs under scan_path (OR). Empty = all format matches.

inject_source_path: bool

Inject _source_path column (absolute path of the bronze file).

roots: HashMap<String, String>

Named roots for $name expansion in scan_path (from project config).

protobuf_max_payload_bytes: u64

Max bytes for one opaque protobuf file (from scan.protobuf_max_payload_bytes).

Implementations

impl ScanRequest

pub fn from_frontmatter( project_dir: impl AsRef<Path>, fm: &StagingFrontmatter, ) -> Result<Self>

pub fn from_frontmatter_with_roots( project_dir: impl AsRef<Path>, fm: &StagingFrontmatter, roots: HashMap<String, String>, ) -> Result<Self>

pub fn from_frontmatter_with_config( project_dir: impl AsRef<Path>, fm: &StagingFrontmatter, roots: HashMap<String, String>, scan_cfg: &ScanConfig, ) -> Result<Self>

pub fn resolved_path(&self) -> Result<PathBuf>

Trait Implementations

impl Clone for ScanRequest

fn clone(&self) -> ScanRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ScanRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.