Function cutensorMpCreate 

pub unsafe extern "C" fn cutensorMpCreate(
    handle: *mut cutensorMpHandle_t,
    comm: ncclComm_t,
    local_device_id: c_int,
    stream: cudaStream_t,
) -> cutensorStatus_t

Initializes the cutensorMp library and creates a handle for distributed tensor operations.

This function creates a cutensorMp handle that serves as the context for all distributed tensor operations. The handle is associated with a specific MPI communicator, local CUDA device, and CUDA stream. This allows cutensorMp to coordinate tensor operations across multiple processes and GPUs.

The communicator defines the group of processes that will participate in distributed tensor operations. The local device ID specifies which CUDA device on the current process will be used for computations. The CUDA stream enables asynchronous execution and synchronization with other CUDA operations.

The user is responsible for calling cutensorMpDestroy to free the resources associated with the handle.

Remark

non-blocking, no reentrant, and thread-safe.

Parameters

• handle: Pointer to cutensorMpHandle_t that will hold the created handle.
• comm: NCCL communicator that defines the group of processes for distributed operations.
• local_device_id: CUDA device ID to use on the current process (must be valid and accessible).
• stream: CUDA stream for asynchronous operations.