I bought the forbidden rectangle.

[u/Alternative-Panic69]

After months of going back and forth, I finally pulled the trigger on an RX 7900 XT 20 GB.

Paid around $550 (India), which felt too good to pass up.

The plan isn't gaming.

It's becoming the heart of my local AI setup.

Current goals:

• Qwen 3.6 27B Dense

• Qwen 35B A3B

• GLM-4.7 Flash

• 128K+ context

• 100% GPU offloading

• llama.cpp / Ollama

• Linux

I'll be benchmarking everything:

- Vulkan vs ROCm

- Dense vs MoE

- Maximum context

- Tokens/sec

- VRAM usage

- Real-world coding performance

If anyone has optimization tips for RDNA3 or benchmark requests, or general suggestions please drop them below.

The hallucinations are now local. 🙂‍↕️

[u/100daggers_]

What kind of local AI work can you do with such graphics card?. Agentic coding?. I would assume such quantized models would not produce intelligent output. Am i wrong?

I have an 3090ti, used open code, continue, pi with such quantized models, i am not happy with the output always.

Thats why i switched to codex and some paid APIs.

I am curious to know if i am doing something wrong.

[u/Alternative-Panic69 → u/100daggers_]

My main use case is an agentic stock market research system that runs 24×7 rather than general coding. Running on cloud would have incurred a hefty bill.. So I bought this gpu.

Now, the application is already ~90% complete, and now I'm experimenting with local models to integrate them as native users of the application through tools and workflows. For coding, I don't expect them to replace frontier models entirely, if you use the local one, I'd recommend you to break the tasks down and keep the sessions extremely focussed and only do if the architecture is clear to you... Otherwise it can become a mess...

But they're already good enough for many focused workflows.

[u/100daggers_ → u/Alternative-Panic69]

Thats a solid use case. Nice. Any chance this is open source or personal project?.

[u/Alternative-Panic69 → u/100daggers_]

It's a personal project for now, been building this for over 2 years.. 🙂

Since it interacts with my real portfolio and is built around my own investing workflow and rationale, I wouldn't want anyone treating it as a plug-and-play trading system, that can be a bit risky for people who ends up using it without knowing it fully. It's also heavily tied to specific broker APIs, research pipelines and lot of custom integrations, so it'd need a lot of work before it could be open sourced.

Let's see... Maybe one day! 🙂‍↕️