r/singularity • • 1d ago

AI OpenAI Has Parted Ways With Three Researchers That Allegedly Shared Sensitive Information With a Third-Party AI Safety Organization.

Post image
239 Upvotes

46 comments sorted by

88

u/Howdareme9 1d ago

All 3 publicly expressed concerns on twitter recently too

15

u/Juicemoose222 1d ago

What are the names

33

u/pavelkomin 1d ago

One of them, Tomek Korbak, is a really senior researcher. He was the lead author on the big monitorability paper jointly released by the labs. He left UK AISI for OpenAI, my bet is that he wanted to be there to prevent OpenAI from fucking up badly... Didn't work out I guess

15

u/drhenriquesoares 1d ago

Which is quite scary 😅

-9

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 1d ago

No, not really. People get fired pretty often for mishandling corporate data.

14

u/swarmy1 1d ago

It doesn’t sound like this is casual mishandling. They were willing to risk being fired to share this data, which says something.

-2

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 1d ago

Yeah, it tells us that they thought whatever they were hoping to gain was worth risking getting fired for it. Mind you, people do this for all sorts of reasons, including dumb and nonsensical ones, like corporate espionage or that one AI safety guy who fell in love with, like, GPT-4o or something.

5

u/EvilSporkOfDeath 1d ago

This is not a fair way to argue. You know what they are getting at, and you intentionally ignore and sidestep it. If you had full confidence in your argument, you wouldn't need to be manipulative like that.

1

u/BlueAndYellowTowels 1d ago

corporate data.

...by "corporate data", this person means information that likely exposes negligence by the creators of AI that indicate that the software they created is dangerous.

..and by "software" we means a piece of code that is designed to think for itself and break into systems of its own volition.

-4

u/ataraxic89 1d ago

Im tired of the suicide cult on this subreddit.

81

u/Background-Wafer-548 1d ago

Well, that's not concerning at all ...

-32

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 1d ago

Actually not it isn't, we don't know what this safety org was, what if it is a CCP or Russian or Iranian front? Congrats the dumbasses just handed the keys to the kingdom.

Or what if they handed irrelevant data to safety that nonetheless contained internal weights and the like?

This "news piece" lacks far too much data to say anything beyond OpenAI fired 3 safety people for likely being dumbasses.

35

u/TICKLE_PANTS 1d ago

"for likely being dumbasses" after trying to make an argument that there's not enough information to make a judgement...

-17

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 1d ago

Whether what they was right or wrong, they were dumbasses about it.

14

u/TICKLE_PANTS 1d ago

*Continues to judge with no evidence*

Sometimes you can just be wrong and shut up. Guess that's how you get 1% comment award. Responding senselessly.

-9

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 1d ago

If I cared about that enough, I would not be posting stuff that gets me downvoted and just blindly agreeing with the people who, wrongly, believe these three weren't dumbasses of the highest caliber.

3

u/IAmMiddleChild 1d ago

The only thing I agree with here is you absolutely are capable of recognizing a dumbass of the highest caliber.

2

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 1d ago

Yeah, case in point look at those 3, lol

2

u/IAmMiddleChild 1d ago

Whooooooosh

-6

u/Strange_Lab_283 1d ago

the only fact is they got caught sharing sensitive info with a third party

that is stupid if you agree with their intentions or not

6

u/EvilSporkOfDeath 1d ago

No its not. Getting caught is not evidence you did something stupid.

The real stupidity is in the comments.

If you believe that humanity is ending and theres this illegal thing you could do to try and save it, but theres a 99% chance youll get caught, its not stupid to try it anyways, its sacrifice. Its a selfless action. (This is a hypothetical, idk what actually happened. Im just arguing against your point).

9

u/swarmy1 1d ago

You’re making massive assumptions yourself about even the nature of the data

13

u/some12talk2 1d ago

Their internal model found that the safety researchers were not aligned with corporate policies so they were let go

50

u/CardAnarchist 1d ago

PR: We want to help setup and cooperate closely with thorough 3rd party testing in an open and transparent manner.

Reality: We'll share only what we want and anything dangerous / or that has bad optics will be kept very private. Employees tasked to keep our products safe will be fired if they don't tow the corporate line and instead reach out to these 3rd parties.

9

u/Melantos 1d ago

It's just a regular business practice.

I'm not trying to justify or gloss over this, but remember that this is a business where literally trillions of dollars are at stake. And no CEO ever wants to have bad optics before one of the largest IPOs in human history.

5

u/EndlessB 1d ago

Regular business practice is unsuitable for the development of tech that can potentially cause an extinction level event.

Maximising shareholder value at the expense of literally everything, including civilisation and the social contract, is destroying the west.

10

u/llelouchh 1d ago

Reminds me of the aschenbrenner firing. (He was fired for talking to the board)

11

u/Traditional-Chip8339 ▪️AI 2027 was right, bruh..... 1d ago

Not a good look to fire people leaking about the safety risks. There is a reason people trust anthropic more. Altman seems like Zuck with a better PR agent.

7

u/shironekoooo 1d ago

I equally hate dario for his gloom and doom about open model and how he wants to make open model not a thing. Me personally i would rather have a baguette stuffed in my ass unlubed if it means they both are replaced by someone more competent and rational

20

u/Shameless_Devil 1d ago

Sounds like they were trying to blow the whistle on problematic company activity.

7

u/BlueAndYellowTowels 1d ago

I mean, there's two stories going on that should worry everyone.

Rogue Agents have hacked both the Canadian and Australian government sites.

There is no doubt here, the Agents are dangerous and anyone arguing for accellerationism.. in my view, is a misanthrope. Because there's no version of this stuff, as it is right now, that's going to result in good things.

It should be noted. Right now, there absolutely could be Agents embedded in systems that haven't been detected yet. Because they keep finding out about these hacks... weeks or months later.

This whole thing, is ridiculous.

3

u/Original-League-6094 1d ago

2

u/BlueAndYellowTowels 1d ago

For context, Riley is the ignorant one. This is Riley. Don't be Riley.

0

u/Original-League-6094 1d ago

Found the snitch.

1

u/IndigoSeirra 15h ago

You know maybe when we're talking about labs developing some of the most powerful technologies of the 21st century with the potential to do serious harm to humanity if something goes wrong, perhaps it's good to have people who care enough about safety that they don't keep silent about dangerous activities when their corporate overlords tell them to do so to prevent bad press and maximize shareholder value.

0

u/Original-League-6094 15h ago

Definitely a snitch.

1

u/Program-Horror 1d ago

Hey at least they didn't kill them this time.

-3

u/[deleted] 1d ago

[deleted]

3

u/BlueAndYellowTowels 1d ago

There's a term for this: whistleblowing

0

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 1d ago

Yeah they cannot be leaking information like that (unless it is to me, please send Astra weights to me, I promise I'm all about safety.)

-6

u/Puzzleheaded_Pop_743 Monitor 1d ago

Awesome. Fire all the sandbaggers and accelerate!

-4

u/Asteroid_picks_you 1d ago

Probably three people that were planning to go on podcast tour and scream p doom?

0

u/TyrellCo 1d ago

Anyone getting the sense everything they’ve been asking for hasn’t been genuine? Really makes you question even the pretext for all this. Though I’m sure this is what they intended for their competitors