Skip to main content

Crate yuzu_data

Crate yuzu_data 

Source
Expand description

yuzu-data — native I/O layer. Reads per-symbol price files into yuzu-core Panel matrices. Formats are detected by content: gzip CSV (.csv.gz), plain CSV (.csv), and — with the parquet feature — Apache Parquet (.parquet). NOT a dependency of yuzu-core (which stays WASM-pure); yuzu-data depends on yuzu-core, never the reverse.

Re-exports§

pub use combined::load_combined_panel;
pub use combined::rebuild_combined_panels;
pub use combined::write_combined_panel;
pub use combined::RebuildSummary;
pub use combined::PANELS_DIR;
pub use csv_io::Field;
pub use csv_io::OhlcvRow;
pub use format::Format;
pub use fundamentals::is_fundamental_series;
pub use fundamentals::load_fundamental_panel;
pub use fundamentals::parse_fundamentals;
pub use fundamentals::write_fundamentals;
pub use fundamentals::FundamentalRow;
pub use fundamentals::FACTOR_PANEL_FIELDS;
pub use fundamentals::FUNDAMENTALS_DIR;
pub use fundamentals::FUNDAMENTAL_FIELDS;
pub use fundamentals::REPORT_EVENT_FIELD;
pub use loader::load_panel;
pub use loader::PRICES_DIR;
pub use source::LocalSource;
pub use source::ObjectSink;
pub use source::ObjectSource;

Modules§

combined
Combined per-field panel files: one wide gzip CSV per series (panels/{name}.csv.gz, header day,SYM1,SYM2,…, one row per trading day, empty cell = NaN), holding the full universe. The container reads ONE object per series instead of hundreds of per-symbol files. Same gzip-CSV conventions as csv_io/fundamentals.
csv_io
Per-symbol gzip CSV I/O. Files hold full adjusted OHLCV (day,adj_open,adj_high,adj_low,adj_close,volume, oldest-first); parse_series extracts one chosen Field column into (day, value) rows.
error
format
On-the-wire format detection for data files. Objects can be stored as gzip CSV (.csv.gz, the default write format), plain CSV (.csv), or Apache Parquet (.parquet, requires the parquet feature). Detection is by content magic bytes, not the object key, so a file parses correctly regardless of its extension and existing gzip CSV data keeps working unchanged.
fundamentals
Per-symbol gzip CSV I/O for fundamentals — the native mirror of the Worker’s factor-panels.ts export. Files hold dense, forward-filled fundamental fields (day,pe,ps,pb,…, oldest-first); parse_fundamentals extracts one field column into (day, value) rows. Same format/conventions as csv_io.rs.
industry
Build the symbol -> sector map the yuzu-core neutralization ops need, from the tracked/*.csv.gz snapshot (symbol,sector,market_cap).
loader
source