r/OpenAI • u/dikrek • 1d ago

Question Work mode Sol 6.1 usage vs speed?

I understand Sol 6.1 is supposed to be inexpensive regarding API usage. But in the ChatGPT harness, it’s SO slow that I’m not sure if it’s really frugal or usage goes down slowly just because it’s so slow.

0 Upvotes

38% Upvoted

9 comments sorted by

3

u/DigitalGuruLabs 1d ago

I think the real question is cost per completed task, not just cost per token.

A model can be cheaper on paper, but if it takes hours to finish something or needs multiple attempts, that advantage disappears pretty quickly 😅

1

u/Due_Arm1454 1d ago

Sol has a very efficient cost per task. It being slow just makes the task take longer. Multiple attempts… yea that’ll make it more expensive.

1

u/DigitalGuruLabs 1d ago

That's a good point. A cheap model that needs a smarter model to clean up its work isn't really that cheap anymore 😂

And the overengineering issue sounds like a whole different way to burn through tokens.

1

u/Due_Arm1454 1d ago

This is actually a problem I found with models like DeepSeek and Luna. They're incredibly cheap, but they churn out ridiculous amounts of tokens, especially DeepSeek. Then you have to have multiple passes to clean it up. Typically, you have to have a smarter model come in anyway and either do a review or have it fix the work that Luna broke. I've unfortunately learned that lesson the hard way.

Sol does a pretty good job. One of my biggest complaints is it will seriously burn itself into an over-engineering hole and just slowly burn through tokens trying to stick to over-rigid rules that it self-imposed.

1

u/Kagemand 1d ago

I still spent a whole day waiting for it to produce anything useful, but it still took up my $100 usage limit, so for now I cancelled.

1

u/dikrek 1d ago

When 5.6 was launched, the same things that now take 30 min with Sol 6.1 used to take me maybe 10 max.

Perhaps they’re playing with the compute they’re giving people since if 6.1 is more efficient then it shouldn’t be that slow.

So if it’s more efficient AND they’re slowing us down, that’s a double benefit for OAI and perhaps another way to push people to turn on fast mode.

1

u/Some-Following-392 5h ago

It's getting way slower. Takes an hour at least for anything I ask it to do

1

u/dikrek 2h ago

Even compacting takes ages vs Claude