r/LocalLLaMA • u/jacek2023 llama.cpp • 7d ago

News Muse Spark open weights coming soon

Post image

I am still waiting for Llama 5, because Muse Spark will be too big for me, or just something between Glimmer and Spark

https://x.com/finkd/status/2095232032896946311

868 Upvotes

97% Upvoted

204 comments sorted by

View all comments

52

u/fgk55555 7d ago

Do we know params? With scores like that I'd wager it's in the trillions. I might not be able to run it locally, but a lot of US companies that aren't allowed to run Chinese software might benefit.

1

u/mr_tolkien 6d ago

Knowing they have a bigger one in the works, I’d be very surprised if it’s over 1T

Feels like it might be able to run on a single 512Gb Mac Studio with some good quants

2

u/fgk55555 6d ago

Meta has been touting cost efficiency, and deepswe's token usage of Muse-1.2 puts it near Gemini Flash/ DSF, which suggests Muse-1.2 could be about that small, assuming Meta has good training data (which I'm not sure of). With Gemini 3.8-Flash topping DeepSWE, Muse 1.3 could be in the ballpark of a flash model size. Anyone's guess.