Expand description
shaled is a layer-streaming tensor execution engine designed to execute
massive (>100GB) 4-bit model files slice-by-slice directly from disk into RAM.
Re-exports§
pub use error::ShaledError;
Modules§
Type Aliases§
- U4
- Placeholder 4-bit unsigned integer type alias targeting
nibbles1.0 specifications.