Skip to main content

Module mlx

rusty_commit::providers

Module mlx 

Source
Expand description

MLX Provider - Apple’s ML framework for Apple Silicon

MLX is Apple’s machine learning framework optimized for Apple Silicon. This provider connects to an MLX HTTP server running locally.

Setup:

  1. Install mlx-lm: pip install mlx-lm
  2. Start server: python -m mlx_lm.server --model mlx-community/Llama-3.2-3B-Instruct-4bit
  3. Configure rco: rco config set RCO_AI_PROVIDER=mlx RCO_API_URL=http://localhost:8080

Structs§

MlxProvider
MlxProviderBuilder
ProviderBuilder for MLX