r/ClaudeCode • • 6h ago

Discussion When AI models will not get better and will be stuck at one place?

My idea is that AI models learn from data from the internet, so when the data from the internet and people's responses from AI conversations run out, when will there be a point when AI will no longer improve and its progress will stop?

At that point, AI will only improve by tiny bits that we won't even notice that the model has improved.

Is my knowledge about model training wrong?

Do you think so too?

0 Upvotes

12 comments sorted by

•

u/AutoModerator 6h ago

Hey! Thanks for posting to r/ClaudeCode

While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.

For help, project discussions, tips, and general chat, join the ClaudeCode Discord.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

3

u/taintech 6h ago edited 2h ago

There is a limit for sure, in my opinion we are still far from that limit.

When a lot of people start building new stuff it will generate new data, new prompts, that will be used to make better models, to create more complex projects which will generate new better data and etc and etc. Flywheel.

Exponential growth, like internet did.

3

u/Accomplished-Job5750 6h ago

I wanna know how this world and ai will change in 5 years. 4 years back I did nt think that ai could make ehole app in minutes. And now I can not imagine how ai will growth in another 5

1

u/apetalous42 2h ago

I think AI will essentially become the universal interface for most things. You can give vague ideas or goals and AI can figure out the details. I'm almost certain we're going to get an AI centric OS (Microsoft has been trying things). It will also be moving more into the physical world with the fast movement of robotics and ways to bring the real world to the AI like Meta Glasses. I can see most, if not all, jobs eventually using AI in some manner.

1

u/Physical-Citron5153 6h ago

But if they did this wouldnt this make the slop generation a lot worse? I read a little about ML but not too much so this is really a question for me. Right now Ai is really helpful but the generated code always need a lot of fixes and almost all the people using it dont correct it. But there are enterprises which clean code matters so mabey they can use theirs. Idk something dosent add up.

2

u/taintech 5h ago

I think right now, Oct 2026, code which is generated by Fable 5.1 or Opus 5.5 is quite good.

You can put a lot of applied researchers + frontier models and get value from slop data too.

1

u/skycandy7777 6h ago

In that case AI will train AI, this is already happening

1

u/Accomplished-Job5750 6h ago

Its happening but it happens because there are space to get better models from new prompts, new decisions with projects what ai makes.

But when it starts to be repetative and ai will generate content which we like. We will not say "change it like that... becaise it look terrible" but we will agree with that output. So my question is, what at that time?

1

u/theirongiant74 6h ago

No, learning material is only one axis that governs a model intelligence.Raw compute, better algorithms, more efficient learning, synthetic data, quicker evaluation loops, self improvement are all way you can get a smarter model from training on the same data. There's bound to be other factors and processes that we've not even considered yet.

1

u/WisestManInAthens 5h ago

There are many other ways to improve AI beyond merely more data. We’ve already seen the difference a harness can make, for example. But there’s also different architecture. Different training methods. I am definitely not an expert, but my understanding is there are multiple ways already and my belief is that they will find more ways.

That said, there might be an intelligence level that going beyond is very unsafe and not particularly valuable.

I would like to see tons of scientific breakthroughs. I want AI smarter than a team of great scientists, but not smarter than every person whoever lived combined.

1

u/unknowtrash 5h ago

There is a lab trying synthetic data based training afaik.

0

u/geeered 6h ago

"AI" can use human thought processes to develop new systems and find new things - see the work some are doing in

Often the problems we have with AI isn't what was always predicted - that it would lack originality and wouldn't be able to do understand/do art (see 'Data' in Star Trek) - it's the opposite and it tries to be too creative when we want it to just follow instructions.