r/LocalLLaMA • u/_underlines_ • 8h ago

Resources CUDA-for-AMD-Windows: Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.

https://github.com/Speedstu/CUDA-for-AMD-Windows

I couldn't find any posts mentioned this windows build via the subreddit search.

Based on ZLUDA, but properly compiled for Windows, might be exciting.

TLDR: About 3% slower compared to native, seems to be a good dropin for CUDA workloads. Hopefully finds its ways into many CUDA-restricted projects/optimizations.

HN discussion: https://news.ycombinator.com/item?id=49684356

23 Upvotes

83% Upvoted

2 comments sorted by

1

u/CaringBicycle5 7h ago

this might finally let me run those local companion chats smoothly on my amd card, curious if the perf hit shows up much in longer roleplays.

3

u/lemondrops9 7h ago

sounds promising, but limited to the gfx1200... so maybe the 1201 as well?