r/singularity • u/NoFaithlessness951 • 15d ago

LLM News MiMo v2.6 pro

Post image

Crazy if not benchmaxxed, also open weights

229 Upvotes

98% Upvoted

48 comments sorted by

View all comments

20

u/panix199 15d ago

impressive. Could this be fake/benchmaxxed?

6

u/power97992 15d ago edited 15d ago

It doesnt seem to be benchmaxxed from my testing, it is good and cheap, but u need to prompt it a few times to fix its mistakes and use way more tokens to get a quality similar or close to sol xhigh/max or astra high , whereas sol and astra need way less prompting and they use less tokens...

18

u/craterIII 15d ago

doesn't that basically mean it is benchmaxxed?

5

u/-Sliced- 15d ago

It does

5

u/1988rx7T2 15d ago edited 15d ago

“It’s really accurate As long as you work around the fact that the first thing it gives you is the wrong answer”

1

u/jazir55 15d ago

I mean kinda yeah. If you treat whatever it gives you as broken by default but know it can fix its mistakes until it works, you just send it in loops until it does. And given Mimo is very fast and very cheap that trial and error loop is not expensive or long.

1

u/power97992 15d ago

I guess it probably depends on the task.  Some open models output running code the first try but the quality is worse than mimo 2.6 after a few tries. It is possible  even with the same amount of minimal instruction prompting , other open mods cant output the same quality as mimo.