chat-mlx 0.0.0

Local-inference chat-rs provider (and CLI) for MiniCPM5 / Llama / Qwen models on Apple Silicon via MLX.
1
2
3
4
5
6
7
pub mod cache;
pub mod config;
pub mod constraint;
pub mod generate;
pub mod model;
pub mod sampler;
pub mod template;