Skip to main content

Crate shaled

Crate shaled 

Source
Expand description

shaled is a layer-streaming tensor execution engine designed to execute massive (>100GB) 4-bit model files slice-by-slice directly from disk into RAM.

Re-exports§

pub use error::ShaledError;

Modules§

error

Type Aliases§

U4
Placeholder 4-bit unsigned integer type alias targeting nibbles 1.0 specifications.