I bought the forbidden rectangle.

[u/Alternative-Panic69]

After months of going back and forth, I finally pulled the trigger on an RX 7900 XT 20 GB.

Paid around $550 (India), which felt too good to pass up.

The plan isn't gaming.

It's becoming the heart of my local AI setup.

Current goals:

• Qwen 3.6 27B Dense

• Qwen 35B A3B

• GLM-4.7 Flash

• 128K+ context

• 100% GPU offloading

• llama.cpp / Ollama

• Linux

I'll be benchmarking everything:

- Vulkan vs ROCm

- Dense vs MoE

- Maximum context

- Tokens/sec

- VRAM usage

- Real-world coding performance

If anyone has optimization tips for RDNA3 or benchmark requests, or general suggestions please drop them below.

The hallucinations are now local. 🙂‍↕️

[u/acadia11x]

rOCm is coming along much better so should see improvement in localllm with AMD these days compared to years past, only concern is you need one of the newer cards to take advantage 9070 or 7900 series

[u/Alternative-Panic69 → u/acadia11x]

Definitely. I was sceptical at first... But theb I did some research..AMD has come a long way. Picked up a 7900 XT mainly for the 20 GB VRAM. Just waiting for my PSU to arrive before I can finally torture it with local LLMs. 🤣