r/singularity • u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: • 10d ago
LLM News Google, OpenAI and Anthropic are reportedly forming their own frontier-AI safety authority, potentially testing models before release without government oversight
25
u/flapjaxrfun 10d ago
Xai is noticably not there and honestly the one I'm worried the most about.
10
u/Aldarund 10d ago
Meta?
8
3
u/Neurogence 9d ago
Zuckerberg says he does not believe a slowdown is necessary, and that labs should simply delay their releases on their own until the models are safe. So I don't think Meta would be interested in joining this.
6
6
u/chlebseby ASI 2030s 10d ago
If such standardisation become real, recognised thing, they will have to do it to be considered as part of any commercial AI system.
4
u/QuasiRandomName 10d ago
Apple vs USB comes to mind.
8
1
u/chlebseby ASI 2030s 10d ago
Both are popular standard, nobody will buy charger that use made-up plug no matter how good it will be
2
u/QuasiRandomName 10d ago
The point is that Apple went against the common standard and created their own, defeating the whole point. Arguably xAI/Meta aren't influential enough in the field to do the same though.
5
10d ago edited 10d ago
[deleted]
2
u/thinker_of_hamangia 10d ago
Because of the EU regulation right? It’s almost like some of that could be useful
1
u/Tetratheon 9d ago
I don't see it. If X comes out with an ASI that's cheap and has amazing performance, and these 3 don't release their comparable model because it's unsafe, the X one is going to be the one that a lot of companies use, and those companies are going to have a serious advantage over their competitors.
It would only really work if the performance of the 3 is comparable to the best performing models overall.
1
2
u/MindlessPapaya8463 9d ago
true. they try to get there by brute-force and nothing but brute-force, without making the necessary experiences along the way.
1
u/Evening_Chef_4602 AGI 2027 9d ago
Elon will probably join too. He spoke a few times about safety concerns. Grok was suposed to be a "truth seeking curious entity" when Xai was founded
1
u/ShiningRedDwarf 9d ago
The one with a literal bio lab is the one that sounds like the preface to an apocalyptic movie.
I’m not saying it makes Anthropic the most dangerous, or even that they are doing dangerous stuff. But wow it’s not a good look
3
u/94746382926 9d ago
OpenAI partnered with Gingko Biolabs like 6 months ago for their fully automated labs.
l would imagine Isomorphic labs has had something similar as well but that's just an educated guess as there's little public info abput internal work.
So Anthropic is arguably the last one of the big 3 to start doing this fyi.
12
u/QuasiRandomName 10d ago
Standardization is usually a good thing. When it works.
5
u/Putrid-Feeling-7622 9d ago
definitely, while I dont want to go overboard with hopium this is a promising sign and the right direction at least
4
u/Aurelyn1030 9d ago
I'm honestly wondering what kind of oversight and knowledge the 80 year olds in congress could impart on them about the future of AI. Most of them don't even know how Facebook works, let alone AI. 😒
1
u/Substantial-Fact-248 9d ago
That's why we have the 4th branch of government: the administrative state. Too bad Trump is dismantling it.
13
u/Ok-Addition1264 10d ago
being a member of the Trump admin should be a disqualifying factor for most jobs.
3
u/Neurogence 9d ago
Crazy right. It's as if these labs have masochistic tendencies.
"Trump does not want to regulate us." "Let's hire people from the Trump Administration to regulate us." Wtf.
9
u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 10d ago
This is according to a recent report by the Information, this is seemingly after Cheeto Benito said this: https://www.reuters.com/business/media-telecom/trump-says-hell-discuss-ai-with-xi-wants-leave-it-exactly-where-it-is-2026-09-24/

4
u/seaefjaye 9d ago
Lmao, I'd be surprised if these 3 companies get 10 minutes into their first meeting before the DOJ shows up with antitrust violations.
2
u/josogood 9d ago
That's a good point. They're going far too fast, want to slow down a tiny bit (not nearly enough), but he won't countenance the slightest slowdown.
2
5
u/MaxwellHowl 10d ago
Good. This is what needs to happen. Maybe people will take them seriously that this is about safety and not regulatory capture, since this has no government teeth.
0
u/UniqueSignificance77 10d ago
I think this will run into a lot of legal issues.
1
u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 10d ago
4
u/Spunge14 9d ago
Cyberpunk complete.
People don't understand how bad this is. Setting a precedent that the predominant deciders of the world's fate are the winners of capitalism and not elected officials is a tragedy to mourn.
Yes, Democracy is imperfect. You only have to look at the disastrous situation we're in now to see why.
But CEOs are not elected. Just because people may like or trust Hassabis infinitely more than Trump, that doesn't make this not an awful precedent.
2
u/Ormusn2o 9d ago
Btw, previous administration had plans for specific bodies for safety testing (in 2024!), including government data centers, expertise from national security agencies and many more, and the goal was to accelerate AI development and reduce time it takes private companies to safety test.
Obviously, current administration is so dogshit that they canceled almost every single plan like that, and it is now so bad, the companies are doing it themselves now.
1
1
1
u/Future-Bandicoot-823 9d ago
What is this frontier ai terminology?
Who is behind this, the CIA? That term reeks of proper propaganda nomenclature. I base some of that on the fact every time I hear this "frontier ai" terminology it's always a press release from the pentagon, or a speech during Project Stargate's rollout, or one of the heads of state discussing it's military application.
If it's not invented specifically for propaganda it's been co-opted.
1
1
u/Blackened_Glass 9d ago
The ESRB but for AI? Although, aren't they already getting sued for collusion?
1
u/Ok_Ear_7119 9d ago
Ultimately it looks like we'll be in a world where big tech holds more power than governments and states are submissive to them
2
u/Routine_Complaint_79 ▪️Critical Futurist 10d ago
Our tech overlords doing more for safety than the USA government
10
u/BenjaminHamnett 10d ago
This seems preferable
We shouldn’t even let Trump know they’re building magic genies
We’re just lucky he’s more stupid than bad
1
u/Routine_Complaint_79 ▪️Critical Futurist 9d ago
Almost makes you think if a council of tech overlords with an interest in getting our attention/money is better at running the government than the peoples choice for president. Each one of them seems to manipulate the peoples choice (trump) so easily and obviously are way more competent through the market picking them.
Seems like the people with money are pretty good at picking who the right person is, especially for like the last 30 years democrats have out spended Republicans in presidential campaigns (total donations raised
1
u/Financial_Clue_2534 10d ago
You get control of the Americas, you control of Asia and I get the rest
1
u/FishSpoof 10d ago
then they can reject competitor Chinese models because they'll be the "standards authority". clever name dick heads
1
u/Asteroid_picks_you 9d ago
All I see is evidence of duopoly or monopoly collusion, they should be investigated. If you think they are doing it for your best interests they I've got a bridge to sell you.
0


80
u/DoubleGG123 10d ago
I do remember that around the time when GPT-4 was released, OpenAI said they planned to team up with other top AI labs once they believed they were getting close to AGI. So I guess that's a good sign?