Expand description
PurRDF’s first-party, byte-deterministic Parquet bridge.
The codec projects an RDF 1.2 purrdf_core::DatasetView plus a
purrdf_core::ContentStore into the fixed five-table schema exposed by
schema. Its deliberately narrow Parquet subset keeps the implementation
wasm-clean and auditable: INT64/BYTE_ARRAY columns, flat OPTIONAL fields,
PLAIN values, RLE definition levels, Data Page V2, and UNCOMPRESSED or ZSTD
page bodies.
No vocabulary is built into this crate. Every IRI is carried from the caller’s dataset verbatim.
Re-exports§
pub use error::CanonicalReason;pub use error::ColumnarError;pub use error::ColumnarSinkError;pub use error::ColumnarWriteError;pub use error::CompactReason;pub use error::ConstructionReason;pub use error::EncodingReason;pub use error::MetadataReason;pub use error::PageBodyReason;pub use error::ProjectionReason;pub use error::ReaderReason;pub use error::ValueBodyReason;pub use error::ZstdReason;pub use schema::ColumnSchema;pub use schema::PhysicalType;pub use schema::Repetition;pub use schema::Table;pub use schema::TableSchema;
Modules§
Structs§
- Bloom
Options - Standard split-block Bloom filter sizing for each admitted column chunk. Filters are opt-in and never affect values or exact native reconstruction.
- Column
Options - An explicit physical override for one schema column.
- Columnar
Ordinal Read - Requested provenance bound to the actual dataset of a complete strict read. No public constructor accepts caller-assembled rows or a replacement dataset.
- Columnar
Projection - A validated canonical five-table projection with its own dense term ids.
- Columnar
Read - The result of a complete Parquet-to-RDF conversion.
- Columnar
Write - The result of a complete RDF-to-Parquet conversion.
- Parquet
Files - Exactly one Parquet file for each member of
Table::ALL. - Projection
Rows - A borrowed traversal of a canonical table’s rows.
- Projection
Term Graph - An exact rejected term graph retained without expanding shared children.
- Table
Write Report - Physical output counts for a table in
crate::Table::ALLorder. - Write
Options - Runtime physical layout choices; these do not change the RDF projection.
- Write
Report - Result of a complete five-table sink export.
Enums§
- Columnar
Ordinal - One original zero-based row in a Columnar RDF table.
- Columnar
Ordinal Value - Original row fields translated by the strict reader’s dictionary-to-kernel map. The IDs belong only to the dataset held by the accompanying read evidence.
- Compression
- Page compression selected for one deterministic five-table write.
- Encoding
Policy - Physical encoding candidates admitted for one column chunk.
- Projection
Cell - A cell in the native v1 five-table projection.
Traits§
- Blob
Source - A verified content identity with a known-length, replayable payload source. Source reads must remain stable until the export finishes.
Functions§
- project
- Project an RDF view into the authoritative five-table schema.
- read
- Read PurRDF’s exact five-table Parquet profile back into RDF and blob values.
- read_
with_ ordinals - Complete the same strict read while retaining only requested original rows.
- source_
manifest - Describe all five actual files in canonical schema order.
- write
- Project any RDF 1.2
DatasetViewandContentStoreinto five Parquet files. - write_
to - Emit each of the five files in
Table::ALLorder without retaining a complete output file. Each callback must accept its whole chunk or fail. For ordinary Rust writers, the callback can select the table’s writer and usestd::io::Write::write_all, or the existing CoreWriterDrainadapter. - write_
with_ blob_ sources_ to - Write native uncompressed files with window-bounded blob payload storage.
- write_
with_ options - Export into resident file buffers through the same incremental writer as
write_to. The complete returned files are additional output storage.