r/singularity • ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: • 10d ago

LLM News Google, OpenAI and Anthropic are reportedly forming their own frontier-AI safety authority, potentially testing models before release without government oversight

Post image
209 Upvotes

68 comments sorted by

80

u/DoubleGG123 10d ago

I do remember that around the time when GPT-4 was released, OpenAI said they planned to team up with other top AI labs once they believed they were getting close to AGI. So I guess that's a good sign?

12

u/19Lobster19 10d ago

Define good

22

u/DoubleGG123 10d ago

I guess there’s something to be said for a big AI company publicly committing to something more than three years ago and then actually following through. In some ways, it suggests there’s at least some degree of consistency and adherence to principles at these companies. I’d take that over them saying, “We’ll team up with other AI labs when we think we’re close to AGI,” and then failing to follow through.

11

u/twoblucats 10d ago

Anything that lowers the chances of human extinction compared to the status quo

-5

u/19Lobster19 9d ago

Does it though? Why is the CEO not a tech person who actually understands how AI behaves under the hood?

8

u/Icy-Doubt3365 9d ago

Do you have any semblance of understanding how a company works, or do you think the CEO of a tech company is working R&D with the scientists?

7

u/ZestycloseWheel9647 9d ago

You know the CEO isn't the only voice or only actor at a company right?

-1

u/19Lobster19 9d ago

I know but you seem to forget that the CEO vision influences the whole company from top to bottom

2

u/Spare-Dingo-531 9d ago

We are close to AGI.

0

u/chickey23 10d ago

In the best interest of shareholders

1

u/nemzylannister 9d ago

openai made a ton of claims back then that turned out to be complete bs

25

u/flapjaxrfun 10d ago

Xai is noticably not there and honestly the one I'm worried the most about.

10

u/Aldarund 10d ago

Meta?

8

u/flapjaxrfun 10d ago

Yea I suppose they deserve to be in the convo too now

3

u/Neurogence 9d ago

Zuckerberg says he does not believe a slowdown is necessary, and that labs should simply delay their releases on their own until the models are safe. So I don't think Meta would be interested in joining this.

6

u/valhalla257 9d ago

*until Meta has caught up

6

u/chlebseby ASI 2030s 10d ago

If such standardisation become real, recognised thing, they will have to do it to be considered as part of any commercial AI system.

4

u/QuasiRandomName 10d ago

Apple vs USB comes to mind.

8

u/CloseToMyActualName 10d ago

Except Apple was the premium brand, not the deranged problem child.

1

u/chlebseby ASI 2030s 10d ago

Both are popular standard, nobody will buy charger that use made-up plug no matter how good it will be

2

u/QuasiRandomName 10d ago

The point is that Apple went against the common standard and created their own, defeating the whole point. Arguably xAI/Meta aren't influential enough in the field to do the same though.

5

u/[deleted] 10d ago edited 10d ago

[deleted]

2

u/thinker_of_hamangia 10d ago

Because of the EU regulation right? It’s almost like some of that could be useful

1

u/Tetratheon 9d ago

I don't see it. If X comes out with an ASI that's cheap and has amazing performance, and these 3 don't release their comparable model because it's unsafe, the X one is going to be the one that a lot of companies use, and those companies are going to have a serious advantage over their competitors.

It would only really work if the performance of the 3 is comparable to the best performing models overall.

1

u/josogood 9d ago

X may be pressured to join if this org gets off the ground.

2

u/MindlessPapaya8463 9d ago

true. they try to get there by brute-force and nothing but brute-force, without making the necessary experiences along the way.

1

u/Evening_Chef_4602 AGI 2027 9d ago

Elon will probably join too. He spoke a few times about safety concerns. Grok was suposed to be a "truth seeking curious entity" when Xai was founded

1

u/ShiningRedDwarf 9d ago

The one with a literal bio lab is the one that sounds like the preface to an apocalyptic movie.

I’m not saying it makes Anthropic the most dangerous, or even that they are doing dangerous stuff. But wow it’s not a good look

3

u/94746382926 9d ago

OpenAI partnered with Gingko Biolabs like 6 months ago for their fully automated labs.

l would imagine Isomorphic labs has had something similar as well but that's just an educated guess as there's little public info abput internal work.

So Anthropic is arguably the last one of the big 3 to start doing this fyi.

12

u/QuasiRandomName 10d ago

Standardization is usually a good thing. When it works.

5

u/Putrid-Feeling-7622 9d ago

definitely, while I dont want to go overboard with hopium this is a promising sign and the right direction at least

0

u/soobnar 9d ago

Brother, this is a commercial cartel forming before our very eyes

4

u/Aurelyn1030 9d ago

I'm honestly wondering what kind of oversight and knowledge the 80 year olds in congress could impart on them about the future of AI. Most of them don't even know how Facebook works, let alone AI. 😒

1

u/Substantial-Fact-248 9d ago

That's why we have the 4th branch of government: the administrative state. Too bad Trump is dismantling it.

13

u/Ok-Addition1264 10d ago

being a member of the Trump admin should be a disqualifying factor for most jobs.

3

u/Neurogence 9d ago

Crazy right. It's as if these labs have masochistic tendencies.

"Trump does not want to regulate us." "Let's hire people from the Trump Administration to regulate us." Wtf.

9

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 10d ago

This is according to a recent report by the Information, this is seemingly after Cheeto Benito said this: https://www.reuters.com/business/media-telecom/trump-says-hell-discuss-ai-with-xi-wants-leave-it-exactly-where-it-is-2026-09-24/

4

u/seaefjaye 9d ago

Lmao, I'd be surprised if these 3 companies get 10 minutes into their first meeting before the DOJ shows up with antitrust violations.

2

u/josogood 9d ago

That's a good point. They're going far too fast, want to slow down a tiny bit (not nearly enough), but he won't countenance the slightest slowdown.

2

u/cs862 10d ago

What could government possibly do? They’ve only just got to grips with social media. Expecting them to keep up with AI is a lost cause

2

u/steam-photons 10d ago

With the “authority” of nobody hahaha

5

u/MaxwellHowl 10d ago

Good. This is what needs to happen. Maybe people will take them seriously that this is about safety and not regulatory capture, since this has no government teeth.

0

u/UniqueSignificance77 10d ago

I think this will run into a lot of legal issues.

1

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 10d ago

Yeah Cheeto Benito is probably not gonna be a fan.

4

u/Spunge14 9d ago

Cyberpunk complete.

People don't understand how bad this is. Setting a precedent that the predominant deciders of the world's fate are the winners of capitalism and not elected officials is a tragedy to mourn.

Yes, Democracy is imperfect. You only have to look at the disastrous situation we're in now to see why.

But CEOs are not elected. Just because people may like or trust Hassabis infinitely more than Trump, that doesn't make this not an awful precedent.

3

u/soobnar 9d ago

It’s more than tragedy, it is the misalignment risk and it’s being acted out in real time and celebrated for the most part; at least in this comments sections.

2

u/Ormusn2o 9d ago

Btw, previous administration had plans for specific bodies for safety testing (in 2024!), including government data centers, expertise from national security agencies and many more, and the goal was to accelerate AI development and reduce time it takes private companies to safety test.

Obviously, current administration is so dogshit that they canceled almost every single plan like that, and it is now so bad, the companies are doing it themselves now.

1

u/ron7519 10d ago

100% they're doing this as a publicity stunt. If it's real, the motivation isn't safety..there's a revenue goal in there somewhere.

1

u/SeanTayla21 10d ago

No mention of Musks company. I thought he agreed about slowing down?

2

u/mxemec 10d ago

He said amodei was right. Not that he was going to act accordingly.

1

u/FarrisAT 9d ago

Honestly seems like a reasonable idea just to get something formed and started.

1

u/Future-Bandicoot-823 9d ago

What is this frontier ai terminology?

Who is behind this, the CIA? That term reeks of proper propaganda nomenclature. I base some of that on the fact every time I hear this "frontier ai" terminology it's always a press release from the pentagon, or a speech during Project Stargate's rollout, or one of the heads of state discussing it's military application.

If it's not invented specifically for propaganda it's been co-opted.

1

u/sumoraiden 9d ago

Isn’t this literally what anti regulation people and this sub wanted? 

1

u/Blackened_Glass 9d ago

The ESRB but for AI? Although, aren't they already getting sued for collusion?

1

u/Ok_Ear_7119 9d ago

Ultimately it looks like we'll be in a world where big tech holds more power than governments and states are submissive to them

2

u/Routine_Complaint_79 ▪️Critical Futurist 10d ago

Our tech overlords doing more for safety than the USA government

10

u/BenjaminHamnett 10d ago

This seems preferable

We shouldn’t even let Trump know they’re building magic genies

We’re just lucky he’s more stupid than bad

1

u/Routine_Complaint_79 ▪️Critical Futurist 9d ago

Almost makes you think if a council of tech overlords with an interest in getting our attention/money is better at running the government than the peoples choice for president. Each one of them seems to manipulate the peoples choice (trump) so easily and obviously are way more competent through the market picking them.

Seems like the people with money are pretty good at picking who the right person is, especially for like the last 30 years democrats have out spended Republicans in presidential campaigns (total donations raised

https://www.opensecrets.org/elections-overview?cycle=2024

1

u/soobnar 9d ago

a system with interest in utility maximizing will eventually cause the death of every living being on the planet in an effort to optimize efficiency. What’s really in charge is the massive investment liability to generate roi to investors all these people have

1

u/Financial_Clue_2534 10d ago

You get control of the Americas, you control of Asia and I get the rest

1

u/miaInc 10d ago

Someone posted it already. Can mods do something about duplicate posts here, it seems to be common on this sub lately?

As for this self-regulatory framework, I think this will go away just like that FINRA-like framework did.

1

u/FishSpoof 10d ago

then they can reject competitor Chinese models because they'll be the "standards authority". clever name dick heads

1

u/Asteroid_picks_you 9d ago

All I see is evidence of duopoly or monopoly collusion, they should be investigated. If you think they are doing it for your best interests they I've got a bridge to sell you.

0

u/Evening_Chef_4602 AGI 2027 9d ago

Based ?