ztensor

A simple, safe tensor serialization format with zero-copy reads, streaming writes, and built-in compression.

Installation

pip install ztensor           # Python
cargo add ztensor              # Rust
cargo install ztensor-cli     # CLI

Features

• Zero-copy memory-mapped reads
• Streaming, append-only writes
• Zstd compression and checksums
• Dense, sparse (CSR/COO), and quantized tensors
• Convert from SafeTensors, GGUF, Pickle, NumPy, ONNX, and HDF5

Documentation

• Website — guides, API reference, benchmarks
• Spec — file format specification
• docs.rs — Rust API docs

License

MIT