Skip to main content

paged_write

Function paged_write 

Source
pub fn paged_write(cache: &Array, new: &Array, slots: &Array) -> Result<Array>
Expand description

cache ([blocks, kv_heads, block_size, D]) with the positions new holds ([T, kv_heads, D]) written into their slots: slots[t] (integers, [T]) is block slots[t] / block_size, position slots[t] % block_size. Slots must be distinct. In place when the evaluation owns the cache, as crate::slice_update.