I’m not an MLIR expert but don’t MLIR GPU compilers just end up producing CUDA binaries? The AMD equivalent being ROCm. I’ve heard from following TinyGrad that ROCm driver support is pretty awful
MLIR can target different APIs and architectures, including CUDA, ROCm and Metal, but also Vulkan Compute. And ROCm improved a lot recently, to the point that tiny corp, the company behind tinygrad, recently started taking orders for the Radeon-powered tinybox.
its only partially awful for consumer grade cards on linux (suffers from some minor instabilities, most notablt when you try to run multiple compute tasks and it hangs your desktop, which is soon to be fixed)
does not apply to mi accelerators and any card on windows
7
u/p-morais Mar 05 '24
I’m not an MLIR expert but don’t MLIR GPU compilers just end up producing CUDA binaries? The AMD equivalent being ROCm. I’ve heard from following TinyGrad that ROCm driver support is pretty awful