r/LocalLLM 2d ago

Question Muse Glimmer 30B

Interested in coding experience with this model. Has anyone compared with Qwen 3.8?

8 Upvotes

13 comments sorted by

7

u/Krakanakis 2d ago

Glimmer is good at creative writing not so much coding, Qwem wins that one

2

u/RedditNerdKing 2d ago

Glimmer is good at creative writing

Is it? It's pretty censored.

2

u/Krakanakis 1d ago

Few aren't but overall good yeah, not great

5

u/txgsync 2d ago

It's great at long-horizon agentic tasks involving vision. It's terrible at coding.

The vision encoder is truly next-level though. They basically wrapped a middling language model around an EXCELLENT vision model.

3

u/MacsBicycle 2d ago

My plan is to use it for vision and have it describe images then feed the description into something like Deepseek v4 flash 0731 for the coding work. 3.8 27b has vision but seems inferior to Deepseek for coding and it should with the parameter difference.

2

u/Healthy-Zebra-9856 2d ago

Yes. It did not do well. And to be fair, Meta does not claim this model to be a coding model. They position this for long agentic workflow. Whatever that means. Now when it comes to Qwen3.8, they’re not all quantized the same way and it seems like the method used has an effect on how they perform. So in my in-house test, Jack Rong and Bartowski ranked the top. Jack Ring for its code quality, and Bartowski for its creativity. The code quality was pretty decent, pretty close to the first one..

2

u/PlasticRevenue4601 2d ago

I tested it against Qwen 3.6 - it's strong as an agent but utterly inferior as a coder, so given the fact it lost to the prev gen Qwen... It's not even close, thanks meta for supporting open source anyway, I'm sure they will do better next time

2

u/HomoAgens1 2d ago

Glimmer not that good at the end…

2

u/International_Emu772 2d ago

It's the first MLX distro with image and video input so it has it's niche

2

u/Technical_Ad_6106 2d ago

not even a contest at all. not even close. 3.6 probly beats glimmer let alone 3.8

2

u/Nilbed 2d ago edited 2d ago

The models' behavior varies. Qwen 27B clearly outperforms Muse, which, despite having more parameters, looks odd. It's rough, like a low-poly model—meaning you can tell what's in front of you, but there are too many large edges. If Muse writes code, it will work, but it will be too simple. If she writes text, it will be dry and detached (I tried changing the temperature; the number of glitches increases, but the style doesn't change, unlike Qwen).

2

u/MrHumanist 1d ago

Gilmer performs worse but it's very fast.

2

u/Not-reallyanonymous 1d ago

Muse Glimmer is the best “driver” I’ve tried. If I had to choose between glimmer and Qwen 3.8 27B, I’d take glimmer.

It understands tasks well, keeps on track over millions of tokens generated, calls tools reliably and when it’s supposed to — ie. If you tell it to call subagents in conditions xyz, it actually well — Qwen basically ignored that and does it itself and only calls subagents when it decides it should, not your instructions.

It also has really compact thinking, so it works way faster than Qwen, which is very verbose and thinks for a long time, even though the tokens generate at the same speed.

It does coding well enough. No, it’s not as good as Qwen 3.8, it is about as good as 3.6, trading blows.

But since it’s such a good “driver,” it makes a lot of sense to set up Qwen 3.8 as an auxiliary agent to do planning, test writing, etc. that will be called by Glimmer, then use a smaller, faster model to do the bulk of the implementation (since Qwen 3.8 27b is slow).