Expand description
Whisper’s encoder on wgpu (Metal / Vulkan / DX12 / WebGPU). Whisper is a VANILLA
bidirectional transformer, so this is simpler than the conformer: the FFN/projection GEMMs +
layernorms reuse the encoder’s kernels, and the only per-block custom kernel is plain scaled-dot
attention (no rel-pos term — see crate::parakeet_gpu for the harder conformer variant). The
conv stem stays on the CPU (runs once); the N transformer blocks run GPU-resident in one submit.
The CPU WhisperEncoder is the parity oracle.
Structs§
- Whisper
Decoder Gpu - The Whisper decoder, resident on the GPU. Consumes a loaded
Whisperfor its weights + params. - Whisper
Encoder Gpu