I think I did know this at some point, but I was reminded today that unlike the (sometime) black box that is CUDA https://github.com/ROCm/ROCm is actually available on Github, which is operationally much nicer!
I also recall learning that NCCL, which is open, https://github.com/NVIDIA/nccl is in part because some of it was funded by the Lawrence Berkeley National Laboratory!
Leave a Reply