Module chunked_write 

Chunked dataset writing: chunk splitting, compression, index building.

Structs

ChunkOptions

Options for chunked dataset creation.

ChunkedDataResult

Result of building a chunked dataset.

WrittenChunk

A chunk that has been written to the file buffer.

Functions

align_chunk_offset

Round a file offset up to the next cache-line boundary.

build_chunked_data_at

Build chunked data with absolute addresses. If maxshape has unlimited dims, uses Extensible Array index.

build_chunked_data_at_ext

Build chunked data with absolute addresses and optional maxshape.

build_extensible_array_at

Build a complete Extensible Array at a known absolute address.

build_fixed_array_at

Build a complete Fixed Array at a known absolute address.

serialize_v4_single_chunk_pub

Build the complete chunked dataset blob (chunk data + index) and return layout/pipeline messages. base_address is where the blob will be placed in the file. Serialize a v4 single chunk layout message (public for OH size estimation).

split_into_chunks

Split raw data into chunk-sized pieces based on shape and chunk dimensions. Returns a Vec of (chunk_offset_per_dim, chunk_raw_bytes).