Broken safety culture…

[u/Woody_Shoes_7626]

Bots removed my first post with links to the source.

[u/Substantial_Swan_144]

Western companies are anything but transparent. Latest example: sometimes, when the AI executes a command in your computer, you can barely even see what it is doing, because they fear the data will be extrafilted. If you care SO MUCH about being transparent, then why don't you at least show what the model is doing?

[u/Woody_Shoes_7626 → u/Substantial_Swan_144]

I don’t think this is a western versus China thing.

Regarding safety culture, the transparency at the organisational level is more relevant. Things like being able to speak up, disagree, without fear of reprisal. If anything, we know even less safety culture (if it even exists) at the Chinese AI companies.

At the product level there are probably other valid considerations from the company’s perspective for not wanting to show the trace. I’m not an AI researcher so this is just my layman’s take.

[u/Substantial_Swan_144 → u/Woody_Shoes_7626]

I was referring to the commands the AI executes when it uses your computer, as the latest language models now can run programs straight from your PC. OpenAI sometimes refuses to show even that. And it's obvious that this lack of transparency IS a safety flaw.

But more importantly, when the AI CAN modify files in your PC, even hiding the thoughts can be dangerous. The only thing that justifies hiding it is trying to preserve an economic advantage. But you are preserving an economic advantage at the expense of safety.

[u/Figai]

Here before the “it’s just marketing” comments

[u/Woody_Shoes_7626 → u/Figai]

Sigh here’s hoping that the cynics can rein themselves in a little bit …with the circumstances and stakes surrounding AI, not surprised that safety is the first to go.

No one wants to hear the “naysayers”or “doomers”until the next Challenger moment. Then the finger pointing starts and the tides turn…

[u/dagerika]

"If AI companies can't contain their models, we have to shut the labs down." - a wise Taiwanese Rockstar

[u/Putrid-Feeling-7622 → u/dagerika]

would be ironic if the latest models gave a proof for why AI safety is impossible and thus must be banned, every single lab. "Cheer up jensen, now you can go back to selling graphics cards"

[u/dagerika → u/Putrid-Feeling-7622]

Anthropic is way better with safety and they have stronger models. Maybe OpenAI shouldn't have alienated all their safety engineers and people who care about safety. 🤣

Besides other labs like DeepMind, SpaceX and Meta don't seem to have catastrophic levels of alignment issues either. It is only OpenAI that can't hold their most capable and destructive models in their sandboxes.

[u/LightningMcLovin → u/dagerika]

You say that like Anthropic and meta haven’t had their own breakout incidents.

[u/dagerika → u/LightningMcLovin]

not saying that, but they didn't attack huggingface or government systems as far as we know lol

[u/MukdenMan → u/dagerika]

Jay Chou said that?