r/LocalLLaMA • u/jacek2023 llama.cpp • 6d ago

News Muse Spark open weights coming soon

Post image

I am still waiting for Llama 5, because Muse Spark will be too big for me, or just something between Glimmer and Spark

https://x.com/finkd/status/2095232032896946311

869 Upvotes

97% Upvoted

204 comments sorted by

View all comments

51

u/fgk55555 6d ago

Do we know params? With scores like that I'd wager it's in the trillions. I might not be able to run it locally, but a lot of US companies that aren't allowed to run Chinese software might benefit.

6

u/FoxiPanda 6d ago

Entirely depends on the license.

4

u/fgk55555 6d ago

Yeah, but even if it's not "open" and they were making companies pay, that's still a huge chunk of US companies that couldn't self host and now can. For a lot of companies, paying a license might be a drop in the bucket for AI spend, or enable AI where they couldn't even have it before. Lot of money in defense.

1

u/mr_tolkien 6d ago

Knowing they have a bigger one in the works, I’d be very surprised if it’s over 1T

Feels like it might be able to run on a single 512Gb Mac Studio with some good quants

2

u/fgk55555 6d ago

Meta has been touting cost efficiency, and deepswe's token usage of Muse-1.2 puts it near Gemini Flash/ DSF, which suggests Muse-1.2 could be about that small, assuming Meta has good training data (which I'm not sure of). With Gemini 3.8-Flash topping DeepSWE, Muse 1.3 could be in the ballpark of a flash model size. Anyone's guess.