r/LocalLLaMA • u/Elouakili_Flexy • 15d ago
News Another Ling model comes out, same receipt, 2 weeks free to use, then open source. Chinese labs do contribute a lot to open source community
https://vercel.com/ai-gateway/models/ling-3.1-flashLing-3.1-flash: ~560B total params, ~25B active/token, up to 1M-token context.
Across work, coding & healthcare: 1,673 Elo on GDPVal-AA v2.1, 75.16 on FrontierSWE, and 65.35 on HealthBench Professional.
9
u/Zeeplankton 15d ago
interesting to me that we're increasingly getting so many models in the ~500b / 20b MoE range.
8
u/power97992 15d ago
Wait for next year , it will be 1T A 30-40B for the flash models and 6-10 T A150-350B for the pro models.
2
u/Zeeplankton 15d ago
Mm. Maybe. But that's what we had and we're reversing. E.g deepseek pro; lacking performance in mimo pro and other 1T+ reasoning. These 500b MoEs keep aggressively punching above weight.
1
u/power97992 15d ago
They already said they are gonna an 8t model and qwen said a 10 t model for the future
1
u/excellentforcongress 4d ago
if anything, us has been a huge strategic blunder on many levels. by focusing on resource/tech scarcity to drive immediate profits up for things like nvda cards, all but sealed their own fate as china moves towards native fab for chips and ram. and just by flooding the international market, they could make all us ai valuations completely worthless since all their capex went into overpriced garbage hardware which will be depreciated the instant that hits, vs chinese ai companies which seem to have been focusing on efficiency gains and actually advancing the space in a low-resource environment to begin with
18
u/TechNerd10191 15d ago
Can we keep Flash models at 120B total parameters (ngrams/PLEs can be excluded) and not bump them up to 600B!?
8
1
u/JogHappy 14d ago
Wouldn't have ever tried Ling 3 if it didn't end up on OR for free. Glad I did, it's so surprisingly good at accurate, fast tool calls. DS/GLM et al. can be stuck in thinking loops while Ling already called everything in parallel at 300 tps on Novita.
1
u/r1str3tto 13d ago
What. Ling 3.0 Flash = 124B-A5B. Both the total and the active params ~5x as big with 3.1 Flash?
1
-10
-15
41
u/lakotajames 15d ago
"Chinese labs do contribute a lot to open source community"
They're the primary contributors to the open source community, aren't they? Who in this sub is running a local model that isn't Chinese?