kopitiam-gpu 0.0.1

GPU parallel-compute foundation for KOPITIAM: wgpu compute pipelines with a runtime GPU->CPU fallback cascade. Domain-agnostic parallel compute infrastructure, not tied to any one field.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19

//! The compute operations, each implemented on BOTH the GPU and the CPU.
//!
//! Every op here implements [`crate::ComputeOp`] (a GPU kernel + a pure-Rust
//! twin) and is runnable through the [`crate::Executor`] cascade.
//!
//! * [`vector_add`] — the demonstrator that proves the cascade end to end.
//! * [`matmul_nt`] — `y = x @ w^T`, the shape a transformer linear layer
//!   actually performs, and where a decoder-only model spends nearly all of its
//!   time. Read that module's warning before assuming it makes anything faster:
//!   it re-uploads the weight on every call, and making GPU offload *pay* needs
//!   the weight resident on the device across calls.

pub mod block_q8_matmul_nt;
pub mod matmul_nt;
pub mod vector_add;

pub use block_q8_matmul_nt::{block_q8_matmul_nt_cpu, ResidentBlockQ8Weight, BLOCK};
pub use matmul_nt::{matmul_nt_cpu, matmul_nt_gpu, MatmulNt, MatmulNtInput};
pub use vector_add::{vector_add_cpu, vector_add_gpu, VectorAdd, VectorAddInput};