https://www.hpcwire.com/2023/10/05/how-amd-may-get-across-the-cuda-moat/
CUDA is a huge advantage for NVidia, and is really baked in to a lot of workflows (PyTorch being a part of that!)
Having a good quality ROCm backend makes porting significantly easier – AMD have made significant efforts on testing and support too. Also, they have generally structured their software to mirror CUDA, which makes switching fairly seamless. It’ll be interesting to see how folks reading to the MI300, and the opportunities given that much HBM per card!