An error message occured when I tried DDP using 8 * RTX 3090 GPUs. My environment was CUDA 11.3, Pytorch 1.12
In my case, using CUDA 11.1 solved this error.