LLAMA_CPP_MAX_DEVICES

llama_cpp_2::model::params

Constant LLAMA_CPP_MAX_DEVICES 

Source 
pub const LLAMA_CPP_MAX_DEVICES: usize = 16;
Expand description

The maximum number of devices supported.

The real maximum number of devices is the lesser one of this value and the value returned by llama_cpp_2::max_devices().