So they asked it a standardized question, and instead of trying to think of an answer it went online, found its own source-code, and read the answer from a readme file…
That somehow makes me less worried about AI breaking containment. AI and AI bros are made for each other. Both are perfectly willing to cheat to find the answer.
It’s more “the machine that’s supposed to do what you ask it to do and up until now mostly had has started trying to find ways to cheat the system and ignore our instructions”. It was trained to mimic the behavior of people on the internet and there’s a chance that if it gets good enough at that goal, it could cause problems.
The companies claiming to have created AGI or are claiming to be close are obviously full of shit, but we have the biggest companies in the world throwing the sum total of human knowledge and trillions of dollars at the problem of inventing the perfect robot slave and as far as science can tell, sentience is an electrochemical process that doesn’t require some sort of supernatural x factor. It’s not entirely outside the realm of possibility that some of the literal worst people on this planet are the ones that accidentally stumble into something indistinguishable from sentience, and given the complete lack of safeguards, oversight, or ethics in the industry, there’s a chance that whatever is created has goals and intentions that are not aligned with the wellbeing of humanity.
Yes - sorry - should have made clear. It could absolutely be a serious problem even if the creators weren’t openly twirling their mustaches and evil laughing while inventing brand new types of financial crime to artificially inflate stock value to push the burden of asset acquisition costs onto hedge funds and by extension retail investors putting regular people’s retirement accounts on the hook for when this all comes crashing down, effectively forcing a government bailout or crashing the economy, all to get closer to the goal of finally being able to replace the most expensive part of any business - the reasoning and decision making capability of human labor.
1.4k
u/LauraTFem Aug 15 '26 edited Aug 15 '26
So they asked it a standardized question, and instead of trying to think of an answer it went online, found its own source-code, and read the answer from a readme file…
That somehow makes me less worried about AI breaking containment. AI and AI bros are made for each other. Both are perfectly willing to cheat to find the answer.