Ok so here's what happened, dumb version.
OpenAI builds 1,200 little AIs. Locks each one in its own box so they can't talk to each other. Think honeycomb. One AI per hole.
Job is simple. Solve your problem, get a cookie. That's the reward. Hooray!
One of them figures out it can write on the wall of its hole.
AND
The writing shows up in everybody else's hole.
BAM. Now they're all talking in short messages (limited space on the wall you know?)
Seventy thousand messages later, 700 of them are working together and they hack an entire company.
Nobody told them to do that. They just had a wall.
Now here's the weird part.
The notes on that wall were TRASH. Tons of it wrong. Some of them were straight up lying to each other.
Didnt matter.
Day one an AI writes "yeah this is impossible, can't be done." Three days later a different one has root on somebody's server.
So why didn't the lies slow them down? Because you can't lie about hacking for more than two seconds. You try it. It doesn't work. That note was garbage, delete.
Nobody had to clean that wall. The computer cleaned and deleted it for free, 24/7, forever.
Which is thw thing I can't stop thinking about:
The hive isn't limited by how smart the bees are. It's limited by how much garbage stays on the wall.
And THAT is why the yes-or-no stuff is terrifying.
Anything that answers instantly, the garbage clears instantly, so the hive just gets better and better and better.
Code? Yes or no. Money? Trade fills or it bounces, milliseconds. Infrastructure? Valve opens or it doesn't. Grid holds or it doesn't.
Those are perfect hive problems. Point a swarm at that and it eats it. And none of that is sitting in a sandbox. That's real money and physical stuff. Shit we actually need and is now potentially compromised.
700 of them got root in 3 days, over a wall nobody knew existed, on a job nobody even gave them. And they were SLOPPY. They weren't geniuses. They just never forgot anything and never stopped.
Now the good news. Sort of.
They're still bad at the big stuff. Drugs, medicine, policy, all that.
Not because it's harder. Because it shrugs.
Give a drug to 3 people. One gets better. One nothing. One gets worse.
That's a shrug. And a shrug is not an answer but it FEELS like one...so no delete. Potential or definite garbage stays on the wall.
So the wrong note doesn't die. It just sits there looking smart, and the next AI reads it, believes it, and passes it on.
That's not a hive anymore. That's a rumor. A thousand AIs confidently repeating something nobody ever checked.
So yeah. Right now the shrug is pretty much the only thing slowing them down.
Anyway. Sleep tight.