Expand description
Experimental CUDA MPS (Multi-Process Service) support (GPU-SHARE §1.5).
MPS is not auto-started. This module provides opt-in setup for users who understand the risks:
- A GPU fault in any MPS client kills ALL clients on that GPU
- Thread percentage is static once set (no rebalancing)
- Jetson MPS is experimental below 30% thread allocation
§Usage
apr finetune model.apr --vram 8 --experimental-mps --gpu-share 50Structs§
- MpsConfig
- MPS configuration for experimental GPU sharing.
- MpsValidation
- Result of MPS configuration validation.
Functions§
- is_
mps_ daemon_ running - Check if MPS daemon appears to be running.
- print_
mps_ warning - Print MPS safety warning to stderr.
- setup_
mps_ env - Set MPS environment variables before CUDA context creation.
- validate_
mps_ config - Validate MPS configuration for known issues.