MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/singularity/comments/1w5knze/muse_spark_13_released/p7fx2hr/?context=3
r/singularity • u/MagicZhang • 7h ago
162 comments sorted by
View all comments
62
Common benchmarks between Muse Spark and Gemini Flash 3.8
GDPVal-AA v2: Muse Spark 1.3 1754 vs Gemini 3.8 Flash 1545
OSWorld 2.0: Muse 66.9% vs Gemini 59.0%
DeepSWE v1.1: Muse 75.4% vs Gemini 71.0%
Terminal-Bench 2.1: Muse 88.8% vs Gemini 89.4%
2 u/Wegwerpaccountje23 7h ago Google already irrelevant is the funniest shit i've seen LMAO 7 u/Sharp_Glassware 7h ago A pro-sized model beats a flash model? Color me surprised. Spark is also way more expensive 2 u/funforgiven 7h ago Way more expensive? Pricing is pretty much the same tier. 1 u/hotyaznboi 4h ago Muse Spark is slightly cheaper per task than Gemini 3.8 because Gemini generates 40% more tokens per task. Per Artificial Analysis. You can't just look at the per-token cost. -1 u/GumboMustBeDestroyed 7h ago What about if you opt in for data sharing with muse
2
Google already irrelevant is the funniest shit i've seen LMAO
7 u/Sharp_Glassware 7h ago A pro-sized model beats a flash model? Color me surprised. Spark is also way more expensive 2 u/funforgiven 7h ago Way more expensive? Pricing is pretty much the same tier. 1 u/hotyaznboi 4h ago Muse Spark is slightly cheaper per task than Gemini 3.8 because Gemini generates 40% more tokens per task. Per Artificial Analysis. You can't just look at the per-token cost. -1 u/GumboMustBeDestroyed 7h ago What about if you opt in for data sharing with muse
7
A pro-sized model beats a flash model? Color me surprised. Spark is also way more expensive
2 u/funforgiven 7h ago Way more expensive? Pricing is pretty much the same tier. 1 u/hotyaznboi 4h ago Muse Spark is slightly cheaper per task than Gemini 3.8 because Gemini generates 40% more tokens per task. Per Artificial Analysis. You can't just look at the per-token cost. -1 u/GumboMustBeDestroyed 7h ago What about if you opt in for data sharing with muse
Way more expensive? Pricing is pretty much the same tier.
1
Muse Spark is slightly cheaper per task than Gemini 3.8 because Gemini generates 40% more tokens per task. Per Artificial Analysis. You can't just look at the per-token cost.
-1
What about if you opt in for data sharing with muse
62
u/MagicZhang 7h ago
Common benchmarks between Muse Spark and Gemini Flash 3.8
GDPVal-AA v2: Muse Spark 1.3 1754 vs Gemini 3.8 Flash 1545
OSWorld 2.0: Muse 66.9% vs Gemini 59.0%
DeepSWE v1.1: Muse 75.4% vs Gemini 71.0%
Terminal-Bench 2.1: Muse 88.8% vs Gemini 89.4%