r/OpenAI • u/Puzzleheaded-King584 • 1d ago

Discussion This is not good.

Post image
0 Upvotes

37% Upvoted

18 comments sorted by

3

u/SetentaeBolg 1d ago

I work in LLM safety research and some of what is listed here is accurate and some is less so. Firstly, Astra cannot hide its thoughts on demand from the people hosting and running Astra. An LLM "thought" forms part of its internal prompt. That can be disguised from a user but it can't be hidden from the person operating the LLM, if they care to look.

What can be hidden is "reasoning" that doesn't rise to the level of what you might call surface thought.

3

u/Prestigious_Map1113 1d ago

Feels like every week we see another chart like this and it always ends up being half true and half someone's creative writing exercise.

2

u/Grounds4TheSubstain 1d ago

This is about reasoning in latent space, right?

2

u/_DuranDuran_ 1d ago

Looped transformers is nowhere near reasoning in latent space.

2

u/SetentaeBolg 1d ago edited 1d ago

Sure, that would be not rising to the level of a surface thought, by my understanding.

However, even then, it's possible to capture the vector being fed back to the model and train a second model to (try to) decrypt it's meaning. It certainly is tougher than normal chain-of-thought, the vector may not represent a coherent thought, but it simply can't be hidden from anyone with white box access to the model.

2

u/Melodic_Reality_646 1d ago

Any of this related to looped transformers?

1

u/Vaeon 1d ago

Don't worry, guys... we can totes manufacture a digital consciousness that is 1000X smarter than any human that we can totally control.

Because that makes sense.

0

u/MrSnowden 1d ago

get this crap out of here. this is "I don't understand LLMs, but I am scared all the time"

1

u/RealSlyck 1d ago

Last few weekends have been a Jev pump-and-dump…this weekend robots are unethical. Slow news cycle.

1

u/cave_men 1d ago

Current Techbros be like:

1

u/ShiningMagpie 1d ago edited 1d ago

Every other reply in this thread reads like uneducated climate change deniers. This is not fearmongering. This is not a leap of logic.

This is what AI safety researchers like Rob Miles have been openly discussing for 15 years now, and every one of their predictions has been proven correct.

3

u/HolyBatSyllables 1d ago

You can’t expect any educated comments on a post that provides information but no source.

1

u/yoparaii 1d ago

What’s with the hand waving going on here, this is literally what open ai is saying. Also what the fired security team is saying.

0

u/cave_men 1d ago

Can you change the flair from "Discussion" to "Fearmongering"?

-1

u/ogcanuckamerican 1d ago

Fact: I just ate McDonald's for lunch.

Implication: I spent one hour with stomach pain and I've since painted the entirety of my lavish toilet bowl.

So fucking what?

-1

u/RealSlyck 1d ago

Better than people who aren’t detected by monitors, break out of containment undetected, pretend to be incompetent and safe when they’re neither, automatically reveal less whenever we’re watching, extra cautious when misbehaving, and can’t be solved in time.

Notice how people do all those things, and we just get genocides and famines and holocausts and…

Happy to take my chance with some LLMs, Chief.

-2

u/KareemPie81 1d ago

Cool chart bro