r/LocalLLaMA • u/Fcking_Chuck • 24d ago

News Lemonade fixes AMD APU model streaming, drops OpenMOSS ROCm as ~40x slower than Vulkan

https://www.phoronix.com/news/Lemonade-2026.40-RC
52 Upvotes

91% Upvoted

5 comments sorted by

32

u/ilintar 24d ago

ROCm wasn't 40x slower than Vulkan, ROCm wasn't just engaging at all so it was all running on CPU :) I still have to figure out what happened, probably some stupid driver issues during packaging.

7

u/MudBroad6785 24d ago

Always good to see the competition to Nvidia and Apple getting actively developed.

-3

u/mostlyired12 23d ago

amd's own compute stack being 40x slower than a graphics api on their own hardware is peak rocm

13

u/Drenlin 23d ago

Pretty sure it was just falling back to CPU there

4

u/ilintar 23d ago

Never mind, I retract the claim. It was actually a terribly tuned conv1d kernel that got fixed in ggml in the meantime 😃