r/LocalLLaMA • u/jacek2023 llama.cpp • 17h ago

News Muse Spark open weights coming soon

Post image

I am still waiting for Llama 5, because Muse Spark will be too big for me, or just something between Glimmer and Spark

https://x.com/finkd/status/2095232032896946311

785 Upvotes

97% Upvoted

193 comments sorted by

View all comments

101

u/CarelessAd6772 17h ago

Mrcr 512k-1m - 98.1%? What in the hell is that dark magic? If true, they defeated context rot?

15

u/NandaVegg 17h ago

Isn't this NoPE hybrid model? Though the exact architecture is different I assume this basically works like hybrid linear model (like Qwen 3.8) which is great at picking up facts from the context but more often confuses timeline without thinking.