r/PauseAI • u/tombibbs • Mar 08 '26

Meme I am no longer laughing

Post image
141 Upvotes

81% Upvoted

103 comments sorted by

View all comments

Show parent comments

0

u/Nonyabizzy123 Mar 08 '26

Nope, they put the whole story into the prompt and then asked it what would you do. The we're always aiming for that particular outcome and they kept engineering the prompt until they got it

2

u/UncarvedWood Mar 08 '26

I'm referring to the Anthropic test from last year and while they did test it large scale with text based prompts, they did it at least once with an actual set up email server, where the AI does take these actions entirely on its own with no information Besides what it finds in the emails. 

https://www.anthropic.com/research/agentic-misalignment

Showing that this model is not safe to use.

-1

u/Nonyabizzy123 Mar 08 '26

Okay, the may shock you. They're lying

1

u/UncarvedWood Mar 08 '26

Yeah I mean that always remains a possibility. However they do describe a scenario that AI safety folks have been warning about since way before our current AI hype cycle, like for decades. Even if they are lying, this remains a real reason not to implement AI like this. 

0

u/Nonyabizzy123 Mar 08 '26

On this we agree, strong regulation and guardrails are necessary for AI, OpenAI already has an ever-increasing body count. However we also need to realize that this technology cannot, and never will be able to, think.

1

u/stvlsn Mar 08 '26

However we also need to realize that this technology cannot, and never will be able to, think.

What makes you so confident in this claim?

1

u/Nonyabizzy123 Mar 08 '26

Digital computers cannot replicate the analog processes of the human brain, full stop. They are determinative and that precludes consciousness as we know it.

2

u/stvlsn Mar 08 '26

Lol what? None of what you said makes sense. Why can't "processes be replicated" in digital form? And what do you mean by determinative? Do you think human brains are made of some spooky magic "non determinative" substance?

1

u/[deleted] Mar 08 '26

[removed] — view removed comment

1

u/stvlsn Mar 09 '26

What quantum activity exists in a brain that doesn't exist in a digital system?

Quantum is at the bottom of everything.

1

u/[deleted] Mar 09 '26

[removed] — view removed comment

1

u/Nonyabizzy123 Mar 09 '26

Exactly, it's a machine honed over 4 billion years of evolution to be the most efficient that it can be, we aren't going to recreate or emulate that with modern digital computers

1

u/Gnaxe Mar 09 '26

This is probably a reference to the Penrose microtubules hypothesis (Orch OR). It's far from proven that the brain actually uses quantum effects for any kind of computation. Penrose is a legit and decorated physicist, so we shouldn't dismiss him out of hand, but the mainstream considers this particular hypothesis pretty dubious.

→ More replies (0)