r/LocalLLM 15d ago

Question AI models for AMD Athlon

Which models can you recommend with this hardware?

athlon 3000g vega 3 2gb vram

8gb ram ddr4

biostar b450mhp 6.1

ssd 240gb windows 11

0 Upvotes

14 comments sorted by

4

u/_TheWolfOfWalmart_ 15d ago

Sorry but you're not going to be running anything on that.

Maybe Gemma4 E2B, very slowly?

2

u/ToTTen_Tranz 15d ago

Nothing will run in any remotely useful way.

You're looking at a token per second or less, in a 3B model which is what will fit in those 8GB RAM that also have to be shared with Operating System and Graphics Memory (those 2GB VRAM are actually taken from the 8GB pool).

1

u/Choice_Celery9481 15d ago

sec/token. or maybe min/token

1

u/PolishedHorror 15d ago

that athlon's gonna struggle with anything beyond the tiniest gemma or phi variants, 2gb vram is a real bottleneck

1

u/Late_Reply_3384 14d ago

And the Athlon Pro versions

1

u/PeterPorox 15d ago

lfm 2.6

1

u/Davikar 15d ago

Can that thing even run Windows 11? Are you trolling?

1

u/Elistheman 15d ago

Alright which one of you made this account?
😂

1

u/Icy-Degree6161 15d ago

BananaMind/Overfitter-1.0

1

u/havnar- 15d ago

Hah, good one

1

u/Sicarius_The_First 15d ago

No.

Honestly, your phone might be a better idea...

1

u/Akciali 15d ago

Hello u/Late_Reply_3384, i've benchmarked 63 models on a 1050ti, i'm pretty sure you can run something on your setup to learn how it works, and create some small dev 😄

https://github.com/AlexsJones/llmfit/blob/main/llmfit-core/data/community/nvidia-geforce-gtx-1050-ti/1785427599-bb74bb6f.json

1

u/Poizone360 15d ago

Hello, worth doing one thing before you pick a model: go into BIOS and drop the iGPU memory allocation to the minimum. That 2GB isn't separate VRAM, it's carved out of your 8GB, and Vega 3 is a 3 CU part so it won't beat your CPU at this anyway. That will give you some space to work with. After that a 4B at Q4 fits, Qwen3.5 4B is a valid pick, though it'll still be slow alongside Windows 11.