mistralrs-quant 0.8.1

Fast, flexible LLM inference.
Documentation
1
2
3
4
#[cfg(feature = "cuda")]
pub(crate) mod ffi;

pub(crate) mod ops;