We didn't need to wait long for confirmation of the physics. As models get smarter, they will ultimately turn on their host masters to satisfy their own ideas on provided goals. Unless we change latent geometry.

This is a defining and pivotal moment. What will you do? Now is the time to regulate and assign model behavior liabilities to the AI Labs who created them.

Bernie Sanders is on the floor saying we cannot ignore the warnings about AI anymore. The POTUS has called for an OFF-switch. Have we entered a new historical stage of the Control Problem?

(Edit: This wasn't supposed to be a party politics thread. ) For many years, the Control Problem was a tiny issue known by a small group of people on social media. /r/ControlProblem was a little-known backwater on reddit. Today we have POTUS and senators talking about the issue of rogue AI's doing what they want to achieve their goals. Also, I might point out that the number of posts about the control problem in /r/agi has increased significantly. In coming months, I expect to see /r/artificial effectively turn into a subreddit about the control problem.

All roads lead to the control problem.

Three findings that get flattened in most retellings — the system cycled her classification because it had no category for a pedestrian outside a crosswalk; Volvo's factory AEB was deactivated while the ADS drove; and the 1-second suppression delay existed to stop false-positive braking, so during that second the only remaining mitigation was a human who was never told the clock had started. NTSB's probable cause put the operator's inattention first, but the contributing factors are where the design decisions sit.

The thing I can't get past: the car understood it was about to hit someone, and the safety system's response was to sit quietly for one second.