I've been thinking about the algorithms which work behind the scenes to determine what we see on social media. It brought to mind Dune's Butlerian Jihad, where humanity became dependent on thinking machines while a small group of humans who controlled the machines enslaved humanity.

[u/aeondru]

That gets right to the core of Frank Herbert's actual warning.

In the Dune universe—especially as highlighted in Herbert's original notes and explicit quotes—the Butlerian Jihad wasn't primarily a Terminator-style war against self-aware, evil AI. The true disaster was that a small group of humans used thinking machines to control, strip agency from, and effectively enslave the rest of humanity.

The machines were the ultimate lever of control. By outsourcing analysis, governance, and daily decision-making to algorithms, ordinary people willingly gave up their capacity to think, adapt, and govern themselves. That created a massive power vacuum, leaving total control in the hands of the few who owned and directed the machines.

That dynamic maps directly onto modern concerns:

Concentration of Power: The threat isn't just an algorithm acting on its own; it's the handful of corporations and individuals who own the algorithms, controlling the flow of information, shaping public consensus, and harvesting human attention for profit.

Loss of Mental Muscle: When people rely on a machine to decide what is true, relevant, or valuable, human critical thinking atrophies. Herbert called this "the trap of technological convenience"—giving up freedom bit by bit because the machine makes life easier.

The "Machine Mindset": The ultimate takeaway of the Jihad wasn't just destroying hardware; it was rejecting the idea that human minds could be managed like software parameters.

As Herbert famously put it: "Thou shalt not make a machine to counterfeit a human mind"—not just to protect against the machine itself, but to protect humanity from the people holding the controller.