Distributed

The following pages describe the APIs used to easily perform communication between different processes in CuPy.

init_process_group(n_devices, rank, *[, ...])	Start cupyx.distributed and obtain a communicator.
NCCLBackend(n_devices, rank[, host, port, ...])	Interface that uses NVIDIA's NCCL to perform communications.