Struct VllmInstaller 

pub struct VllmInstaller { /* private fields */ }

The vLLM installer.

Implementations

impl VllmInstaller

pub fn new(config: VllmConfig) -> Self

Create a new vLLM installer with the given config.

pub fn with_defaults() -> Self

Create with default config.

pub fn dependencies(&self) -> &[&str]

vLLM depends on PyTorch.

pub fn validate_dependencies(&self, installed_components: &[&str]) -> Result<()>

Validate that all dependencies are satisfied.

pub fn detect_rocm_mm(&self) -> String

Detect ROCm major.minor version.

pub fn rocm_index_url(&self) -> String

Get the ROCm PyTorch wheel index URL.

pub fn vllm_wheels_url(&self) -> &'static str

Get the vLLM ROCm wheels extra index URL.

pub fn build_vllm_install_command(&self) -> ShellCommand

Construct the pip install command for vLLM from ROCm wheels.

The original script uses: pip install --no-cache-dir --no-deps vllm --extra-index-url https://wheels.vllm.ai/rocm/

pub fn build_deps_install_command(&self) -> ShellCommand

Construct the pip install command for vLLM dependencies.

Installs the core dependencies needed by vLLM (excluding torch and xformers).

pub fn build_versioned_deps_command(&self) -> ShellCommand

Construct the pip install command for vLLM versioned dependencies.

These have specific version pins from the original script.

pub fn build_integrity_check_command(&self) -> ShellCommand

Validate that the vLLM dependency closure is internally consistent.

This is intentionally read-only. It catches stale or missing packages after Rusty’s --no-deps installs without allowing pip to mutate torch, ROCm, CUDA/NVIDIA libraries, or any other stack component.

pub fn triton_cache_env(&self) -> Vec<(String, String)>

Construct the Triton cache environment setup command.

Sets up writable cache directories for Triton kernel compilation.

pub fn build_tools_install_command(&self) -> ShellCommand

Install the build tools vLLM’s source build needs (cmake/ninja/wheel/ setuptools/patchelf). The env already supplies ROCm dev headers + torch; these are the remaining pip-installable build tools. (rust/cargo, if an optional dep ever needs it, is a system package — not pip-installable.)

pub fn build_source_install_command(&self, version: &str) -> ShellCommand

Build vLLM FROM SOURCE against the env’s installed torch.

The prebuilt ROCm wheel is compiled against a specific torch (e.g. 2.11.0) and ABI-breaks against the env’s torch (e.g. 2.12.1+rocm7.2) — vllm._C.abi3.so: undefined symbol: _ZNR5torch7Library4_defE…. Building the sdist with --no-build-isolation compiles the C/HIP extensions against the ACTUAL installed torch, so the symbols match. --no-deps guarantees pip NEVER swaps the env’s torch (vLLM pins torch==). Heavy: compiles C++/HIP (tens of minutes). VLLM_TARGET_DEVICE=rocm picks the ROCm backend. Non-negotiable: the env’s torch is the only torch.

pub fn resolve_version_with_policy( &self, version_lag: u32, min_age_days: u32, ) -> String

Resolve the vLLM version to build, applying the user’s supply-chain gate.

Queries PyPI’s release list (versions + upload dates), drops pre-releases, then picks the newest release satisfying BOTH: (a) not within the version_lag newest (lag=1 = skip the latest), AND (b) at least min_age_days old (0 = no age requirement). Falls back to VLLM_SOURCE_VERSION if PyPI is unreachable or no release qualifies.

pub fn build_force_reinstall_command(&self) -> ShellCommand

Construct the force-reinstall command for vLLM wheel repair.

pub fn build_source_rebuild_command(&self, version: &str) -> ShellCommand

Construct the source rebuild command for vLLM.

Used as a fallback when wheel install fails. Accepts the policy-resolved version (the same value build_source_install_command pins) so the fallback honors the resolve_version_with_policy version-lag / min-age supply-chain gate instead of silently installing the newest bare vllm from source. VLLM_VERSION_OVERRIDE is set for the same reason as the primary source-install path: it suppresses the +rocmNNN build label that mismatches the sdist filename and forces pip to cascade through every release.