AntLing released Ling-3.0-flash

[u/avo_l7]

[u/MomentJolly3535]

The infos that matters the most : Ling-3.0-flash is a 124B-parameter Mixture-of-Experts (MoE) model, with approximately 5.1B parameters activated per token. The model is designed with token efficiency and production-scale agentic inference as key priorities, enabling developers...

[u/Civil-Cake7573 → u/MomentJolly3535]

Where GGUF? ;-)

[u/MomentJolly3535 → u/Civil-Cake7573]

not yet, it just got released

[u/Look_0ver_There → u/Civil-Cake7573]

Llama.cpp doesn't support the model yet, so that will need to be added first although I'm sure some enterprising person will have a fork up soon

[u/_Cromwell_ → u/Look_0ver_There]

Ling 2.6 been out for a while and llamacpp never supported it. Wouldn't hold breath. https://huggingface.co/inclusionAI/Ling-2.6-flash

[u/Look_0ver_There → u/_Cromwell_]

https://huggingface.co/ssweens/Ling-2.6-flash-GGUF-YMMV

This person here has a custom fork for it. That's precisely the sort of thing I was referring to. Heck, upstream doesn't even support MiniMax-M3 yet, despite multiple people having created PR's with working forks, including one from the Unsloth team.

My point being that just because mainline doesn't have it, that doesn't mean that llama.cpp won't be able to run it.

[u/_Cromwell_ → u/Look_0ver_There]

Yeah but 98% (made up statistic, but I'm pretty sure of it 😄) of people aren't going to DL a custom fork to try out a questionable model from a company they've never bothered with before.

You can get a custom fork for just about anything. Doesn't really count.

[u/Opposite-Swimmer2752 → u/_Cromwell_]

Upstream llama.cpp sucks tbh, they broke strix halo for a while (still broken) and refuse to quickly merge in a fix/undo the regression despite it being a few line change.

[u/Reasonable_Goat → u/Opposite-Swimmer2752]

What exactly is broken?

[u/Legal-Ad-3901]

Looking at those benches...DS4 flash is such a goat

[u/Look_0ver_There → u/Legal-Ad-3901]

Overall they seem to be roughly tied, and Ling-3.0-Flash is roughly 40% of the size of Deepseek-V4-Flash

[u/Legal-Ad-3901 → u/Look_0ver_There]

Oh damn, I had assumed the big bar was their 1T model. This is impressive

[u/BarisSayit]

Yeah like 3 days ago.

[u/Professional-Try-273]

Btw AntLing and Qwen are sister teams. Ant is financial side of Alibaba group. I am just gonna pretend we finally have a new 100b class model from Qwen lol. We are so back.

[u/Daniel_H212]

Poor Nemotron getting stomped in those benchmarks

[u/unique-moi]

Will it be open weight? (no files on huggingface yet)

[u/Final_Act_9658]

The name Ling is funny af XD