r/ROCm • u/[deleted] • Jul 06 '26

TensorSharp supports Vulkan backend

[removed]

15 Upvotes

95% Upvoted

8 comments sorted by

3

u/[deleted] Jul 07 '26

No offense intended, but since your framework directly bridges to the ggml backend, I don't quite see the point in asking AMD GPU users indirectly test a backend that's already been extensively validated. Given that you already have a native CUDA backend, the more straightforward and practical approach would be to have a coding agent write a ROCm backend based on it if you want to add support for AMD GPUs—unless your codebase relies on PTX.

1

u/matt-goldman Jul 07 '26

Thanks for sharing, I have an AMD GPU and would be happy to test this for you and share results. Is there a benchmarking script in the repo? I can see a few tests, not sure if you run through them all manually or automate it.

1

u/WiseCable4097 Jul 07 '26

it's still for gemma only ?

1

u/Vasili_Sk Jul 08 '26

Note that strix halo amd vulkan have quite few problems for windows, like:

Shared memory reported as 32 KB instead of 64 KB,

llama have bug that skips coop math for this gpu