Skip to main content

cuda_batch_rows

Function cuda_batch_rows 

Source
pub fn cuda_batch_rows() -> Option<usize>
Expand description

Prompt rows per batched-graph chunk when the CUDA backend runs the graphs (CMF_CUDA_BATCH), None on every other backend.