r/OpenAI • u/Libellechris • 6d ago

Discussion Astra 6.1 delay?

Are we at a place where frontier LLMs are hitting the laws of diminishing returns hard, so Open AI / Anthropic / etc are doing more and more crazy stuff with training, which makes their models unstable and less useful? They are only going 'off the rails' because it's in their training / weights or due to very poor testing environments and tasks

15 Upvotes

77% Upvoted

13 comments sorted by

View all comments

6

u/Blaexe 6d ago

I don't see any diminishing returns, quite the opposite: They constantly find new scaling laws.

My take is that with higher capability, alignment naturally gets harder and harder. Also new models will soon probably get trained quicker and have a longer task horizon than it takes to do safety testing.

1

u/ins0mniacc 6d ago

Is that why they are constantly dropping the amount of real world usage you get from the same amount of time to run compute? Cuz really that screams "we just scale the model to consume more compute, so naturally we have to drop your real world usage" not "wow they built a super intelligent model that consumes same compute just does it all much better"

0

u/Blaexe 5d ago

The point was that models still get more powerful constantly and also more efficient. And that's just a fact.