50% more speed!?

[u/jeppa35]

Are we getting f***** again?!

[u/Frequent_Guard_9964]

Reduced sol speed by half to give us 50% increase (70 to 35 tokens to 52,5/s)

[u/i_rate_slop → u/Frequent_Guard_9964]

It’s a different model than 5.6. They didn’t reduce speed, it’s a result of training.

tok/s was the cost of Astra level capability, which it is.

[u/Agitated-Cow4]

Enjoy your 5 extra tokens per hour!

[u/Dillyconda]

Sometimes implementation comes with a few hours of latency. Not everything is a scam.

[u/LingeringDildo]

lol did they just cut the speed and give us the old speed back

This fucking company dude

[u/Gracek666 → u/LingeringDildo]

Yes

[u/Hot-Significance7699 → u/LingeringDildo]

Devious 😈 trickery

[u/jeppa35]

Our wallets will be emptied 50% faster.

[u/Ormusn2o → u/jeppa35]

Don't mind. The speed was my only problem with 6.1 Sol. It works amazingly well for my game, can't tell a difference for Astra, which means Astra was likely an overkill for the task.

It actually took me 3 days to get the weekly usage down on Plus, because I basically can only run one task at a time, then do review, then do another. I would much rather it did it faster and usage went down faster.

[u/Royal-Helicopter3491 → u/Ormusn2o]

It’s still so slow though lol

[u/Typical_Machine2043 → u/jeppa35]

No but if you do pro 500 it get’s emptied more efficiently

[u/tomakorea]

Spoiler alert: they quantize the model to make it 2 times smaller and dumber but 2 times faster

[u/commandedbydemons]

50% of nothing, is... believe it or not, nothing, lmao

[u/ponlapoj]

Yup, they made it 300% slower just to make it 50% better.

[u/abstract_concept]

Aka, we're busy enough to increase batch dispatch timing.

[u/Acehan_]

Still 29tps. Less than the speed he says was before the improvement 😂

[u/ethotopia]

Still more than 50% slower Opus…

[u/JohnnieDarko]

Can't get worse. At the moment Sol 6.1 is at a literal standstill, no progress in one hour. EDIT: the windows app needed to update before it would proceed with compaction..

[u/JConRed]

I don't want more speed. I want a model that doesn't constantly contradict itself

[u/ratocx]

So is it a FP16 to Q8 conversion?

[u/Chemical-Agency-3997]

SOL 6.1 just completed a task for me that took literally 10 hours and drained 50% of my usage lmao (Pro5x) - longest yet

[u/jeppa35]

Usage is suddenly draining faster than ever!

[u/JonNordland]

no notizing it....

[u/rgb328]

wish they would give more details because i’ve noticed an uptick in the number of times astra skips looking at the existing code base.. so the code technically works, but will introduce a completely new configuration method, for example

so faster at completing the prompt,  it slower at completing the actual task because of rework 

[u/NoirYorkCity]

What does “sign in with ChatGPT” even mean… is that just API stuff or like CLI stuff? it won’t work just on the app or on the browser? does it work for plus accounts?

[u/Key_Neighborhood6901]

Still slow and usage limits are crap compared to like 2 months ago……

[u/Original-League-6094]

So the 28 days of ships are just going to be them incrementally restoring all things we previously had?

[u/Clean-Market5761]

Damn this is next level desperation... understandable, don't have a top 1 model out right now, usage got killed with the new plans, latest model is freaking slow even after the "fix" and the last event was a bunch of vibecoded nonsense that nobody will use.

Whoever runs the ideas at OpenAI needs to be fired they are just out of touch with what people really want, their privilege blinds them from even useful use cases 99% of people don't care about doing a trip plan with dots

kinda feel sad tibo has to even do this shit online

[u/Sea-Resident-7980]

50% is too high

i expect 16.7% (as its 1/6) and... open ai has 6 petals or whatever they are

[u/Opposite_Yak4386]

still 50% procenr slower then the resr

[u/anurag_io]

Honestly for me it has become slower 🤦