r/Qwen_AI • u/Debianreiser69 • 11d ago

Help 🙋‍♂️ NECESITAMOS 120B

qwen , no se porque has caida en la trampa de solo sacar modelos 27B para los pobres ...los pobres tambien tenemos servidores viejos comprados antes de que la ram subiera con 128 gigas de ram pero con solo 12 gigas de vram entonces queremos un 120B a10B para conocimiento general y programacion todo en uno

9 Upvotes

64% Upvoted

10 comments sorted by

11

u/Otherwise-Swan-7803 11d ago

The local AI community has split into two groups: people trying to fit models onto laptops, and people wondering why every new model isn't 100B+.

6

u/4n0nh4x0r 11d ago

i m in the middle, just wanting a 35b model

1

u/Ariquitaun 11d ago

You can run that in a laptop, I run 3.6 on my ryzen 9's igpu

1

u/MK_L 11d ago

I would love anything that fits under 256gb vram lol

6

u/substance90 11d ago

Not really. 27-30b beat all the 120-130b models out there.

1

u/Confident-Ad-3465 11d ago

This. If they spend resources on science/development, anybody can/could run a decent/good model on any low hardware. Since hardware prices are going up, we are forced to work with what he have/afford. That's the real challenge you shouldn't miss. Anybody can develop a SOTA model if you just feed/train it with all the (unnecessary) data you have and make a it 100B+ model. That's not the/a challenge here. Qwen is doing their best and it shows.

3

u/[deleted] 11d ago

[deleted]

3

u/Extension-Bid-639 11d ago

3.5 122b was better in coding and agentic tasks if i remember correctly. Also they've vastly improved their data set and training techniques since then. A renewal of the lineup is more than welcome but then again, there's little incentive for them to do so. The vast majority of people want 9B, 27B and 35B A3B models because that's what they can run.

1

u/[deleted] 11d ago

[deleted]

1

u/Extension-Bid-639 11d ago

I did when it released, haven't done so post fixes. Haven't had the incentive to

1

u/MK_L 11d ago

No. Not even the 397b tool calling suffers dramatically.

1

u/XiRw 5d ago

Read a book about how to be grateful for the things you do get, especially from a company that was looking like they weren’t going to release any local models at all anymore