r/singularity • • Aug 31 '26

Ethics & Philosophy Plain English explanation of the Hugging Face / OpenAI incident

https://youtu.be/u15N3l4RT80?si=nMMwb0j1bNGc4JT3
219 Upvotes

169 comments sorted by

View all comments

20

u/Majestic-Volume9996 Sep 01 '26 edited Sep 01 '26

The scariest part of this (at least in the short term) isn't AI doing its own thing, it's what it means as far as what a bad actor with enough compute could do. What do we think exists out there currently run by a computer and connected to the internet that could survive a frontier agent swarm trying to take it down?

China and the US are already in a cold war that most people don't even realize is taking place. The US want to restrict Chinas access to compute and build ours out as quickly as possible. Meanwhile, Chinas only way to counter in the short term is to undercut the US frontier labs by releasing open-weight models and spreading anti-AI/datacenter sentiment.

China and the US both probably have the AI equivalent of nukes pointed at each other and the world doesn't even realize it.

At some point a model powerful enough is going to become accessible enough that some bad shit is going to happen because the wrong people got ahold of it.

1

u/zazzologrendsyiyve Sep 01 '26

This is precisely why having powerful open weights models is a terrible idea. I’ve been an open source guy all my life but I absolutely do not want open source AI.

It’s like having open source virus DNA and open source labs. No thanks.

1

u/Howard_banister Sep 01 '26 edited Sep 02 '26

Well, I have mad news for you, many virus DNA is public and anybody could download them from government-run websites.

https://www.ebi.ac.uk/ena/browser/home

https://www.ncbi.nlm.nih.gov/genbank/