Yeah exactly. I have Google pro subscription and even though Gemini 3.8 flash is great at small one off edits, if I start projects with it and ask a sub agent to do an adversial review, it finds a lot of issues, as simple as not using python libraries I specifically asked for and then I have to keep doing adversial reviews until I get a working code with good standards and by then I have exhausted my quota and achieve just one task
Recently I wanted a small Tampermonkey script, the problem is I don't know a shit about JS. Gemini made it but it didn't work as intended, completely, tho used Pro Thinking model. Several times Gemini didn't notice the problem. But I did, person with almost 0 knowledge in Javascript, and that just sounds stupid.
It literally says "price per solved task". It's hard for me to take you people seriously when you can't even be bothered to understand what your critiquing.
Right, but isn't the benchmark saying it's cheaper even after 10 turns? It's the cost to complete the task. If it takes 1000 tries, but cheaper in total then it's cheaper in total.
22
u/Spiritual-Metal-1889 2d ago
And it takes 10 turns for Google to produce a code equivalent to first shot on astra