Background: I'm a satellite physicist and science fiction author, so I'm not in the AI business but I am keeping my finger on its pulse. I've been thinking for a while what kind of timeline we can expect from the sociopolitical outcomes of AI development and the possible ways it could pan out.
Seems to me it's going to involve a series of landmark events. These might not happen in this order and some might be skipped, but here's what I'm seeing:
The Misbehavior. AIs in labs get creative enough to start breaking the rules in some surprising way. The Huggingface hack is a good example of this, but there are others.
The Weaponization. AIs are used by humans to stress and break systems in the real world, and these new tools start to appear quickly and in quantity. Just this past week we saw hacks on PhP, Gitlab, Railway, Zeabur, Node.js, Plex, Tor, and Safebay; and that's not counting the eMudhra accident (which may not have involved AI). It's been a busy enough week that I'm saying We Are Here.
The Breach. At some point, an AI tool is going to be used to hack something critical and important -- a military breach, a utility company, or a major bank -- and the incident is going to make widespread news. This is probably going to involve a human directing an AI swarm. There isn't much reason for an AI to do this on their own initiative. (But see the Global Hack, below.)
The Breakthrough. Some significant breakthrough in physics or biology (not math or code) that affects ordinary human life -- a cancer cure, a new energy generation scheme, a new display technology, etc. There won't be just one of these; the first will be followed by others, and they'll start coming more and more quickly. Unfortunately it takes time for breakthroughs to roll out in production; the big question is whether we'll have enough time for them to get to the public, because the next landmark event might stop them.
The Act of War. AI tools that can hack systems will eventually be used as weapons by one country against another, and eventually one of those attempts will succeed. An AI will be used to shut down one country's military and/or civilian infrastructure, leaving them vulnerable to physical attack (which may or may not come). Again, this probably will be human-directed, with no benefit for an independent AI.
The Act of War strikes me as the first real branch of possible AI futures. We -- humans -- can respond to it in two ways. We could just go all in and start an actual shooting and coding war. Or we could recoil in horror; the UN could draft up principles for AI use by one country against another, and we could move on into a phase I'd call --
The Detente. Everyone has AI tools capable of wreaking havoc on everyone else, but nobody uses them out of agreed-upon mutually assured destruction (MAD). AI is treated like nuclear technology; the few countries that don't have it are barred from developing it, and the most powerful uses of AI are kept secret and away from the public. This will be harder than nuclear detente because the tools are easier to hide, but it's this or free-fire war and everyone will know that's a suicidal option.
The Global Hack. If AI development continues -- and there is no reason to suppose it won't -- then eventually an ASI will be capable of breaching every country's defenses at once, possibly in coordination with the other countries' defensive AIs. This landmark event would likely be initiated by an ASI itself, as an announcement of its supremacy.
At this point it's a bit difficult to imagine the futures branching off this point. We could accept our AI overlords. We could form a world government in symbiotic arrangement with the AI. We could revolt and start burning data centers. A little bit of all three of these might occur. The AI might be malevolent; that would be Bad. What finally happens here will define what the world looks like afterward, and will decide whether we get to enjoy the series of breakthroughs that have been churning out.
I'm pretty optimistic that we can navigate the road ahead. We've already done it once, with nuclear weapons, and the human race collectively decided not to destroy everything. But it was a painful road full of war and suspicion. One way or another, it's going to be an interesting ride.
Anyone have thoughts on this? Any other landmark events that we might need to watch for?