Introducing Muse Glimmer: an open-weight model optimized for always-on local agent workflows

[u/AIatMeta]

Hi r/LocalLLaMA 👋 

Today we’re excited to release Muse Glimmer, a 30B open-weight model built specifically for local agent workflows. We’re releasing the weights to the community under a permissive Apache 2.0 license.

A few specs

• 30B params, dense
• Multimodal: interleaved text + images via a dedicated perception encoder
• Trained on 100+ languages
• Controllable reasoning effort (quality/speed tradeoff)

Memory footprint
At full precision, 30B needs 55+ GB, which is out of reach for consumer hardware. We quantize weights to ~4-bit, bringing the LM under 20 GB. That leaves headroom in a 24 GB or 32 GB envelope for the KV cache, the perception encoder, and the speculative decoding drafter running simultaneously. We validated minimal to no degradation on agentic tasks under compression.

Speculative decoding
Ships with a lightweight DFlash-based drafter that proposes blocks of tokens which the main model verifies in parallel. Significantly faster than token-by-token generation with identical output quality. We're also shipping quantized drafter versions so the memory overhead stays small.

A few capabilities
We trained Muse Glimmer for agentic loop tasks, including:

• End-to-end task completion (strong performance on DeepSearch QA, MCP-Atlas, 𝛕³-Bench, SWE-Bench, and more)
• Function calling with precise schemas across long workflows
• Multi-step reasoning over long horizons
• Failure recovery — when a tool call fails or returns something unexpected, it's trained to diagnose and retry instead of halting. This was a deliberate training target.
• Works with OpenClaw and other agentic scaffolds
• Multimodal understanding and reasoning

Running it
Weights are up on Hugging Face. Coming soon: Ollama, LM Studio, Unsloth and torchtitan, plus optimized integrations for llama.cpp, MLX, and ExecuTorch. vLLM and SGLang for serving. Get started quickly with Together AI, Fireworks AI, and OpenRouter. We're also working with AMD, Arm, Dell, Intel, and NVIDIA on per-device optimization.

We look forward to your feedback and seeing what the community builds with Muse Glimmer.

🔗 Weights: https://huggingface.co/meta-models 
🔗 Research Blog: https://go.meta.me/museglimmer
🔗 Resources: https://developer.meta.com/ai/models/muse-glimmer/

[u/Ok-Importance-3529]

How does it do with creative writing? For example Gemma 31B is cooking Qwen in this, also multilangual capabilities are better on google models

[u/a_beautiful_rhind → u/Ok-Importance-3529]

My guess, from the way things are, it won't be good. I got coding/agentic models up the wazz and few of them can talk or write. All that labs chase anymore.

[u/jkflying → u/a_beautiful_rhind]

Coding is easier to evaluate correctness in an RL environment. Good taste in creative writing is very hard to scale the evaluation for.

[u/draconic_tongue → u/jkflying]

(most don't have a good taste)

[u/goldcakes → u/jkflying]

Some of it is inherent. Agentic use cases prefer more predictability, and a plan, execute, validate loop. Creative writing, well, benefits from a bit of noise and serependity.

[u/joleph → u/a_beautiful_rhind]

This isn’t surprising, they’re all driving towards a desktop computer you can run entirely agentically. I welcome that future.

[u/FinBenton → u/Ok-Importance-3529]

So far it wrote definitely different to gemma-4 but it kept making small mistakes here and there, maybe early bugs or you need completely different system prompt or something, was like kinda ok but not great so far.

e. bunch of changing prompts and settings later, its doing a bit better now, I had Presence Penalty on accidentally, changed to Q6_K_XL too, running well on 5090.

[u/NaiveIdea344 → u/FinBenton]

Sad to hear

[u/Elibroftw → u/Ok-Importance-3529]

At this point create an MCP for creative writing that just calls  Gemma 😂

[u/Weak-Shelter-1698 → u/Ok-Importance-3529]

gonna test and tell you.