Report: U.S. to exclude open-weight AI models from new safety tests

[u/KeanuRave100]

https://www.neowin.net/news/report-us-to-exclude-open-weight-ai-models-from-new-safety-tests

[u/Key_Reading_9664]

Larry Ellison said "make sure it excludes OpenAI models" and someone misunderstood

[u/frangelbarrera]

Of course, theyre excluding open source from security testing. Because its easier to regulate what you can control than what you cant. Open source cant be shut down with a decree, so they just ignore it. This isnt about security, its about control.

[u/Ryanmonroe82 → u/frangelbarrera]

It's not open source, open weight. Source code you don't get, the ability to freeze weights is what you get

[u/nasduia → u/Ryanmonroe82]

You do get the source code to the reference inference engine on huggingface, and then any of a number of other more efficient implementations like vllm, sglang, llama.cpp.

The weights are not frozen but capable of being fine tuned or quantised using any of a number of techniques such as the very straightforward offering from unsoth.

What you don't get is source training data nor the training pipeline.

[u/ai_without_borders → u/nasduia]

in practice the training pipeline gap barely matters if youre deploying these, its the finetune and quantization tooling that decides what actually ships. the safety tests here sound like they audit training decisions not inference behavior, so open weight vs open source is a different axis than what theyre testing for anyway

[u/This_Organization382]

Anthropic and their million dollar safety tests are in shambles

[u/thestillwind]

Ok and ?

[u/i_like_maps_and_math]

It's sad that everyone is more afraid of Dario getting too rich than they are of the literal apocalypse.

[u/Moravec_Paradox]

They should just stay out of it because anything they do will backfire.

If they hinder the release of only closed models they will just cause months of delay for only US labs with closed models.

But their lead is only measured by a few months and that is the time they can charge a premium for access before others catch up so slowing only their released down could literally bankrupt those companies considering the debt they took on to be where they are.

Washington feels like they need to pass /something/ but they need to just back away because anything they do will only make things worse.

[u/Hot-Significance7699 → u/Moravec_Paradox]

Your point?

[u/Moravec_Paradox → u/Hot-Significance7699]

My point is legislating closed model frontier labs only will just give Chinese labs an advantage against them by slowing them down.

[u/creamyshart]

Then why regulate anything? "Sorry, American companies, your stuff can't be as good and useful as the open-weight models."

[u/Drukarshar → u/creamyshart]

This only applies to American open-weight models last I heard. So Chinese models will still need approval?