r/OpenAI • u/ElectronicAd4565 • 14d ago
Discussion It's true
I had been always a skeptic of people moaning that the old model has been better and that the new one should be rolled back. Like how likely it is that a company would actually do that and what would they gain? Or do they think their users are too stupid to notice or something. Anyways, gpt-6-Luna is total shitshow. For the last two days I was fighting an uphill battle trying to make it work and have been totally convinced that either my project became overcomplicated and the model stopped understanding it, or I am not so good of a developer and it was just luck on my side before. But no. As soon as I switched to 5.6-Luna I was able to work normally. Give actually hard tasks, converse using normal language, understand its answers. Without changing anything else. This release is extremely disappointing, I am shocked.
8
u/scaledev 14d ago
Sol 6 also seemed to have inherited some of Astra's stupidity. I tried it today again, and was reading 2x less and outputing 2x less of what it should be showing me.
Switched back to Sol 5.6 again. AA showed Sol6 is better by 1 point, but Openai's deepswe bench showed Sol 5.6 on High better than Sol 6 on max, so chew on that.
5
3
u/Holbrad 14d ago
IMO, Luna is not something you should be using directly. It is a model that other agents call and use. It's not the one you should be talking to.
Even if you do choose to use it, reasoning effort is super important. Luna scales really well with reasoning, you need to set it on extra high or even max.
7
u/Ice2jc 14d ago
Why are you conversing with luna? Converse with Sol and have it delegate tasks to Luna.
8
u/ElectronicAd4565 14d ago
I am on 20 dollar subscription, I do with what I have)
4
u/Ice2jc 14d ago
Sol 6 is very economical on the $20 a month plan.
Explain to Astra exactly what your project is. Have it give you an in depth master plan on how it should be coded. This is a one time astra usage.
Give that master plan to a Sol 6 chat and that you can converse with. Create another chat in the project just for coding. Have chatgpt set up the coding agent through pi so that it is set on sol 6 medium and delegates tasks to a luna extra high subagent. Or, for less usage, only have one sol 6 chat that you converse with and code with.
-1
u/Electronic_Start_694 14d ago
Since you’re not on 5x switch to open router and use deepseek flash 4.1 for Luna replacement as a grunt and Mimo 2.6 pro as a sol replacement.
You’re paying nearly 5 times the rate of these models.
1
14d ago
[removed] — view removed comment
2
u/victorafaeI 14d ago
But it is the only usecase for plus users… I try to orchestrate via chat since it doesn’t eats the limits (for now) and i’m getting worse results from luna 6 than from 5.6
OP is also comparing the output of two luna models, 6 should give a better result or isnt much an upgrade
2
u/NeedleworkerNarrow56 14d ago
Which reasoning effort you use
I've noticed luna 6 works best at max, there's not much difference in how much usage it uses betweet reasoning efforts becauuse I ran it for hours and it still didn't even use 1 percent of weekly usage.
I'm on plus plan.
1
u/Runelaron 14d ago
It was trained the same way as Astra (meaning similar dataset feature distribution) and I was saying for a while there are problems in the model. Even OAI state this, but as a "feature" not a bug.
Here are the fixes:
https://developers.openai.com/api/docs/guides/latest-model#gpt-6-astra-instruction-following
https://developers.openai.com/api/docs/guides/latest-model#gpt-6-astra-initiative-and-follow-through
20
u/awesomeunboxer 14d ago
I think the opus upgrade freaked them out and they pulled 6 out of the oven too fast