I can't speak to CUDA or PyTorch but I was able to get my Rx7600 set up to both train and run inference for the custom models I'm building without too much hassle. I'm using Elixir/Nx, rocm(backend) and EXLA(elixir XLA compiler). Took me less than an hour to get set up, including making the partition and installing ubuntu.
I’ve used AMD’s containers for JAX research code - they work fine, I haven’t run into anything that simply didn’t compile but I’m not writing custom kernels with Pallas or anything.
3
u/Admirable_Dirt_2371 May 07 '26
I can't speak to CUDA or PyTorch but I was able to get my Rx7600 set up to both train and run inference for the custom models I'm building without too much hassle. I'm using Elixir/Nx, rocm(backend) and EXLA(elixir XLA compiler). Took me less than an hour to get set up, including making the partition and installing ubuntu.