Skip to main content

Module whisper_gpu

Module whisper_gpu 

Source
Expand description

Whisper’s encoder on wgpu (Metal / Vulkan / DX12 / WebGPU). Whisper is a VANILLA bidirectional transformer, so this is simpler than the conformer: the FFN/projection GEMMs + layernorms reuse the encoder’s kernels, and the only per-block custom kernel is plain scaled-dot attention (no rel-pos term — see crate::parakeet_gpu for the harder conformer variant). The conv stem stays on the CPU (runs once); the N transformer blocks run GPU-resident in one submit. The CPU WhisperEncoder is the parity oracle.

Structs§

WhisperDecoderGpu
The Whisper decoder, resident on the GPU. Consumes a loaded Whisper for its weights + params.
WhisperEncoderGpu