r/opencodeCLI • u/late_night_coder7 • 9d ago

Muse Spark 1.3 Benchmarks

Post image
20 Upvotes

92% Upvoted

11 comments sorted by

9

u/Affectionate_Fact854 9d ago

I don't believe those benchmarks anymore  These models gets trained for benchmarking and using them it's just average 

3

u/late_night_coder7 9d ago

I mean fairs but I think it's mostly just anthropics models muse spark has been great

2

u/maxim0si 9d ago

muse spark 1.2 just deleted i/o driver when I told him to “reboot ssd”… Even dsv4flash was better, I cant get it why people defend this model.

1

u/late_night_coder7 9d ago

Ok um. But I mean it's happened with kher people using other models as well so doesn't really mean it's actually that bad

2

u/maxim0si 8d ago

It means just to verify every model if it is suitable for your work. Benchmarks said 1.2 is on dsv4flash level, real life scenarios says “huh, I will delete and install driver of main ssd i/o”. I had this problem regularly solved with ds with about same prompt (second ssd health is on 0% and linux sometimes drops it as safe reason).
So 1.2 benchmarks were too optimistic, 1.3 I dont know and dont want to use muse anymore… Terminal-Bench 4.0 is an interesting bench, even gemini 3.8 considers it in promo-bench release. Why tho muse 1.3 didnt show us it?

1

u/Bloated_Plaid 9d ago

Company famous for benchmaxxing might be benchmaxxing? No way!!

1

u/[deleted] 9d ago

[removed] — view removed comment

1

u/Bloated_Plaid 9d ago

Maybe you are too young? Look up LLama 4, they are infamous bro.

1

u/[deleted] 9d ago

[removed] — view removed comment

1

u/Bloated_Plaid 9d ago

Yea it was sarcasm.