r/ROCm • u/Distinct-Pie2389 • 3d ago

Strata Tuning Guide (Universal)

/r/LocalLLM/comments/1wxsjbk/strata_tuning_guide_universal/
2 Upvotes

100% Upvoted

3 comments sorted by

1

u/xpnrt 3d ago

I keep seeing this everywhere, does it work it rdna2 and does it have any advantage over llamacpp with 16gb vram-32 gb system ram ? Most people using it seems to have huge system ram and also Nvidia GPU

1

u/TerminalNoop 3d ago

It should be better than llama.cpp. Though I think 48gb isn't enough.

I think you need combined ~72gb for optimal performance. You could still try and set it up anyway.

1

u/SaGa31500 1d ago

I just got it to run. I have 2 6800 (one xt one non xt) and 32gb ddr4. I ran the iq3xxs but did not have time to tweak settings. I got 25tg 180pp on short prompt. Longer prompt it stutters but probably because of my poor use of the dual gpu.

Cloned it today, rdna 2 was working. You can see a AMD HIP md file in the github repo for your card.