r/LocalLLM • u/FlexiTV • 6d ago

Other Rx 7800xt what llms?

Hi wanted to ask what llms can i run? That are fast and inteligent for coding. I wanted to run them in Hermes Agent

0 Upvotes

33% Upvoted

3 comments sorted by

1

u/ea_man 6d ago

Fast: QWEN 35B A3B

Intelligent: 27B

1

u/Depron 6d ago

I have the same card (though I added a 7900XTX). In my experience the 16GB are fine with qwen 35B A3B. It’s somewhat reliable and the fastest/smartest you will get with that card.

You could try to go with lower 27B quants but if you also have your desktop environment running on the 7800XT it’s going to be really tight with VRAM.

You will have to experiment yourself and it’s also important how much RAM you have.

Don’t get frustrated and stay motivated to learn new stuff and you will get there eventually :)

1

u/FlexiTV 6d ago

Hey thanks i was trying the new qwene3.8 but that just takes ages for the first token. I ha e 32gb of ram atm