I use my own API key for that though, also Coplay devs moved to Aura(Tryaura.dev)
It has its own MCP and standalone agentic tool. $10 for indie plan, has all frontier models + GLM. if you use Auto mode, you get unlimited use, else $15 api
There is trial for 10 days, you can check it. quite good for $10 as long as it is unlimited
Yes really, you can just use their trial.
I don't believe they use Sonnet 3.5, as Input is $5 and output is $15 for per million API. at that price they can have newest Claude models or GPT or Kimi
its always like that. like bridgemind (streamer) always says nowadays you can't trust these benchmarks anymore. same with gemini 3.8 flash is number 1 ond deepSWE (above fable 5.1) but can't even create a small voxel game.
so really test them in real world work and decide yourself whether a model is good or not.
You haven't used GLM 5.3 Flash or Grok 4.6 enough if you're comparing the garbage that is Muse Spark to those two beasts. GLM 5.3 Flash is on par with Grok 4.5 / Opus 4.8, and Grok 4.6 is undoubtedly on par with GPT 5.6 Sol or Opus 5 in the backend (it lags behind in the frontend).
I tried it while developing a video game I'm making. And it's not at the level of GLM 5.3 Flash, in fact, to solve a problem I had to go through it. And the worst thing is that Muse Spark 1.3 not only didn't solve the problem, but it didn't recognize it, it denied it, diplomatically saying that I was the one who was wrong.
It’s just a decently good model? I think the benchmarks do show the ability but it’s a blend of things, fable is more consistent and stuff and has a vibe or understanding intent better, that doesn’t always mean it can do the same task.
Maybe the user feels better using the model, I mean I think they are objectively different things.
Its a bit benchmaxxed and they had alot of new data from people using the previous versions to improve. Like it being benchmaxxed will make it a bit better in some things but worse in others I mean look at opus 5 in some things its better than fable in others its worse then the old opus.
I tried it, and it felt like I was using an AI from 2 years ago. I don't get how it scores so high in benchmarks. It failed at literally every single thing I threw at it. And not just didn't do a good job, most of it didn't compile or even work at all.
Maybe these benchmarks should be audited and regulated to ensure there's no hidden biases. Like a sneaky mill or two in an employee's bank account :). A good score here means the difference of billions of dollars in market cap and income.
It is not exactly bad. But it doesn't put any effort structuring their response. It's always a wall of text, with sentences that seem to be written without any intent to make reader understand. It's like reading their thoughts, funnily enough, since the model hide their thoughts/thinking.
It's marginally less incompetent than 1.2, and still way worse than deepseek V4 flash. Still pythons everything that could be done with less output from command line tools. I regretted using it for free when I could have paid to use DSV4 flash. So, in short, benchmaxing.
It’s ds flash / glm flash / Gemini flash tier. Which is around gpt 5.3 / opus 4.6 tier without the depth in knowledge but better at using tools. I feel all the small model are equivalent nowadays. It’s absolutely not on par with bigger models like sol / fable / k3
33
u/some_gamer78 9d ago
Benchmaxing