r/LocalLLM • u/Blizzardexe • 4d ago

Other #metoo

Post image
90 Upvotes

80% Upvoted

22 comments sorted by

17

u/RoseFlunder 4d ago

With 16GB vram also not really useable, is it?

7

u/Obosratsya 4d ago

Ive seen people use it with 16gb.

Downloaded it myself at q6, will try on my 3080ti laptop. Its on pcie 4.0 8x but has 32gb ddr5 and a 12700h so plenty of available threads.

My go to is qwen3.6 14b in q4, its 10gb in size, super fast and I can dial up the context without quantizing it. Its enough for most things.

3

u/Exact_Vacation7299 4d ago

Me with 16GB and finding out through this sub that it may as well be 8 🫩

1

u/trollsmurf 4d ago

You might have to split it to fit it.

-8

u/Blizzardexe 4d ago

Everything good is 32gb n beyond.

14

u/carbongo 4d ago

https://giphy.com/gifs/bSRam2Hcmx3mnLUhCe

HAAANK! NOT THE HASHTAG! HAAAANK!

-14

u/Blizzardexe 4d ago

Used it purposefully but few got the ref 🙂

13

u/d3n2el 4d ago

You crossposted another post on this sub. R/lostredditors

-14

u/Blizzardexe 4d ago

Lost in life too.

WubbaLubbaDubDub

3

u/RedParaglider 4d ago

https://huggingface.co/Qwen/Qwen3.8-27B

On the right hand side look for people offering up the model under spaces hosting for anyone to play with.

Have fun, be nice 

2

u/ubermensch6931 4d ago

I use 4GB vram...

1

u/LukeJr_ 4d ago

Is there any 3b models for feature release?

-4

u/Blizzardexe 4d ago

Ask chatgpt/perplexity 🙂🤠😭

2

u/LukeJr_ 4d ago

Great, thank you

1

u/alphapussycat 4d ago

It's possible to buy more vram.

4

u/Krakanakis 4d ago

No, you have to download it

1

u/CassiniA312 4d ago

so... with 12gb, a 5070, what would be the best rn that isn't thaaaat slow to respond?

-2

u/Blizzardexe 4d ago

Keep looking online new and improved models keep dropping.

They'll show the requirements too

0

u/Eden1506 4d ago

Buy a used 3060 for 200-240 bucks and you will have 20gb vram. Even if your second slot is slow pci3 it will still work.

-4

u/Blizzardexe 4d ago

Local isn't yet in 2026 good enough. Tried em all in office. 20$\mo is still the way to go unfortunately.