Expand description
Core primitives for the Kopitiam Runtime — KOPITIAM’s CPU-first, local-first, Rust-native inference engine.
This crate is to the runtime what kopitiam-ontology is to the Semantic
Runtime: shared vocabulary, no logic, no allocation strategy, no I/O.
Every runtime crate (kopitiam-tensor, kopitiam-loader,
kopitiam-runtime, and the kernel/graph/scheduler crates that follow)
agrees on the types here, so none of them has to depend on each other
merely to name a dtype.
What lives here:
DType— element types, including the block-quantized GGUF formats.Shape— dimensions, strides, reshape and broadcast rules.Device— where tensors live (CPU, and only CPU, by design).Error/Result— the runtime’s single shared error type.
§Relationship to kopitiam-ai
kopitiam-ai owns the ModelAdapter boundary that the Semantic Runtime
talks to; this crate is far below that line. kopitiam-workflow should
never see a DType. The layering is:
kopitiam-workflow -> kopitiam-ai (ModelAdapter) -> Kopitiam Runtime -> this crateStructs§
- Shape
- The dimensions of a tensor, outermost first.
Enums§
- DType
- The element type of a tensor.
- Device
- Where a tensor’s storage lives and where kernels run on it.
- Error
- Every way a Kopitiam Runtime operation can fail.
Type Aliases§
- Result
- The runtime’s result alias.