Crate midas_processor

Crate midas_processor 

Source
Expand description

§MIDAS Dataset Processing Library

High-performance streaming conversion of MIDAS meteorological CSV datasets to Parquet format. Handles BADC-CSV format with metadata extraction and schema validation.

Re-exports§

pub use error::MidasError;
pub use error::Result;
pub use models::DatasetType;
pub use models::ProcessingStats;
pub use models::StationMetadata;
pub use processor::DatasetProcessor;

Modules§

cli
Command-line interface components.
config
Configuration management and validation.
error
Error handling for MIDAS processing operations.
header
BADC-CSV header parsing and metadata extraction.
models
Core data structures and types for MIDAS processing.
processor
Main processing engine with modular architecture.
schema
Schema management and dataset type detection.