Struct WgpuContext 

pub struct WgpuContext {
    pub device: Device,
    pub queue: Queue,
    pub adapter_info: AdapterInfo,
    /* private fields */
}

Owns the wgpu device/queue and a cache of compiled compute pipelines.

Fields

device: Device

queue: Queue

adapter_info: AdapterInfo

Implementations

impl WgpuContext

pub fn new() -> Result<Arc<Self>>

Sync device creation — native only. On wasm use Self::new_async.

pub async fn new_async() -> Result<Arc<Self>>

Async device creation (works on native and wasm32; roadmap v4, pitfall 14: the async form is primary, the sync API is the facade).

pub fn create_storage(&self, size_bytes: usize) -> Buffer

pub fn upload(&self, bytes: &[u8]) -> Buffer

pub fn readback( &self, buf: &Buffer, offset_bytes: usize, size_bytes: usize, ) -> Result<Vec<u8>>

Read size_bytes starting at offset_bytes back to the host. Sync facade — native only (device.poll(Wait) cannot exist on wasm).

pub async fn readback_async( &self, buf: &Buffer, offset_bytes: usize, size_bytes: usize, ) -> Result<Vec<u8>>

Async readback — the primary form; on wasm the browser event loop drives the mapping.

pub async fn readback_many_async( &self, regions: &[(&Buffer, usize, usize)], ) -> Result<Vec<Vec<u8>>>

Read several regions back in one submit and one fence wait.

WgpuContext::readback_async costs a submit and a wait each, which dominates when a single logical step wants several small tensors: the attention probe reads n_layer + 1 per generated token, and one at a time that cost more than the decode itself. Staged into one encoder they cost one round trip regardless of how many there are.

Regions are returned in the order given.

pub fn dispatch( &self, name: &'static str, params: &[u32], buffers: &[(&Buffer, usize, usize)], workgroups: (u32, u32, u32), )

Dispatch name with binding 0 = params (uniform, raw words) and bindings 1.. = buffers (storage). Each buffer entry is (buffer, offset_bytes, size_bytes).

Trait Implementations

impl Debug for WgpuContext

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.