Skip to main content

MAX_TENSOR_ROWS

llama_cpp_4::context::tensor_transaction

Constant MAX_TENSOR_ROWS 

Source 
pub const MAX_TENSOR_ROWS: usize = 4_096;
Expand description

Maximum rows accepted from one selected tensor invocation.