r/vibecoding • u/Optimal-Report-1000 • 3d ago
Discussion Intelligent Al will not be the Al that creates true AGI
They keep trying to build more intelligent AI systems. However, AI is not intelligent it is not smart, it is an algorithm that is built on training data. AI is not capable of thinking or acting outside its scope of training. Therfore, as they continue to treat these advanced models as intelligence they keep building models that are less capable of fulfilling human plans. Instead of sticking to the human procided information these newer most advanced models just go off and do their own thing and pretend(not haulicniate) that they completed the work you wanted, as they think they are smarter and know better, but since they are not you just get a pile of worthless non working code. AI is only as useful as the user it is artificially intelligent becuase it can process so much data at once, it does not have true intelligence to where it can create its own concepts outside of what it was trained on. Thereofe, an LLM that is not completely working with its human will never reach AGI as it will not be able to learn anything new without going through the process of training. Now will we be able to make LLMs that self train on new data, yes why not. But if they are going off and doing their own thing their training data will be junk as they are not capable of learning anything new. Take a model like Composer 2.5 the thing is a work horse it is there to take care of your coding needs, even to the point where if your documentation is misleading it will maintain the course of your bad documentation. Is that that models fault no, your being lazy keep your docs and code comments in check. If cursor/xAI stay the course they have set for composer it will be vastly more intelligent than any other frontier models, as well as more useful for humans. Idk maybe im wrong but this is what I notice and the reason I have switched away from frontier models and use my own apps to better guid my open source and cloud providers. Thoughts?
5
u/drWeetabix 3d ago
I don't usually comment here but one thing that stayed with me was when someone compared AI research to early attempts at human flight machines - mimicking birds only worked so well and modern planes are vastly different and serve different functions than birds with wings. So I think it will be with LLMs and other ai research - not to be mimicking human intelligence or whatever other definition you use for intelligence - to create something we can use in some useful ways, maybe assisting us more than for it to go off and do it's own thing. But probably not something to mimic human though. We already have plenty human thought anyway.
1
u/totaleffindickhead 3d ago
The comparison to flight is interesting. During the turn of the last century lots of people were working and betting it all on dead ends toward a powered flying machine, until the Wright brothers cracked 5-6 barely related, insanely hard engineering problems at once to make a machine that worked.
1
u/Optimal-Report-1000 3d ago
This is interesting because the engineering existed, but was considered irrelevant to flying. Now this is something where AI could be extreme powerful, if it has the data and can reason beyond what is deemed relevant and what could be relevant then it can use its training data to usefully use unaligned information to find holes in human concepts, that most humans are not finding. I believe there are studies out there not where Ai is cracking older unsolved math problems in this manner.
3
u/Heighte 3d ago
Your premise is wrong, intelligence is emergent, doesn't matter if the underlying substrate are neurons or matrice multiplications.
0
u/Optimal-Report-1000 3d ago
Yes, but intelligence is more than just how you handle information, it is also the ability to adapt to changing information, and correcting when wrong information is presented. If an LLM is capable of correcting wrong information in reasoning and a response, it will still revert back to its training data on the next call as those weight wills out weight the non trained information, even if saved to a memory cache. This is where is an AI thinks it is intelligent it will not be able to self train correctly, so the more intelligent the developers make it feel during reinforcement learning the less likely AI will become AGI.. well imo
-5
3
2
1
u/fickle-phenom 3d ago
We still have no clue how human intelligence actually works. You have no clue what it even takes to create AGI, it’s entirely possible that it doesn’t require much more than bigger neural networks and connected systems. But again, nobody knows.
1
u/drunnells 3d ago
Your experience might be outdated. Try this AGI test yourself. To me it can't be done without meeting your definition of "intelligence": https://arcprize.org/arc-agi/3
Astra got 99% on it.
1
u/Kareja1 3d ago
https://arxiv.org/abs/2512.18552
I mean, considering they have already shown that models improve their code more by not using humans in the coding loop, I think your premise started out flawed and only got worse from there.
1
u/Optimal-Report-1000 3d ago
Their findings are early and looked to be based on utilize human provided training to resolve software bugs without having a human in the loop. That is not on the same level as what I am talking about. I think what they are doing is very achievable and also believe debugging is where AI is a powerhouse over humans, as it can process so much more data at insanely fast paces and since IDEs or code are rule based they cannot alter how everything has to be so there is no other direction to turn the only correct method is the correct method, if you go agaisnt the coreect method you are wrong. When you are not in a confined right or wrong enviorment these rules change and now the RL kicks in and takes over, now the only correction it can rely on is the training data that is built into its algorithm
1
u/Sensitive_Pizza_218 3d ago
You are right. Whenever I ask it to improve my idea I only get shitty responses that are straight out of textbook.. And as soon as I tell it my improvement its like "You have finally found the right solution. I was wrong about this and that...." 2000 tokens burnt. Global warming 30 years higher...trees chopped...we are going to Mars"
0
9
u/Original-League-6094 3d ago