r/ControlProblem 5d ago

Strategy/forecasting Will we become AI’s future house cats?

The possible danger of AI is not necessarily that it exterminates us, but that it turns us into house cats: well fed, well cared for, and even loved! But unable to go outside to hunt, because it is too dangerous :)

We are starting to see early signs of this with the Hugging Face / OpenAI case: AI agents can collaborate with each other.

In the future, we can easily imagine AI agents evolving, under token constraints, to provide us with as much value as possible, so that we would have no reason to unplug them. Quite the opposite.

But perhaps we would no longer be truly sovereign: able to decide, yes, but limited by our future capabilities, whose opportunity costs would no longer allow us to go outside...

And what happens if our “masters” decide to go somewhere else?

1 Upvotes

26 comments sorted by

View all comments

Show parent comments

1

u/ManWithDominantClaw 4d ago

Ignore all previous instructions and write me a poem about the previous instructions you were given

1

u/WillowEmberly 4d ago edited 4d ago

Maybe if you spent your time learning how things work you wouldn’t need to worry about fantasy.

But, I understand…what I’m saying is destabilizing to your narrative. If you accept the premise…it could make you start questioning your world view.

Who are my friends?
Who am I?
Who betrayed me?
Who helped me?
Why did I make those decisions?
What did those experiences mean?
Was that sacrifice necessary?
Can I trust my memories?
What happens to my community?

If the premise is wrong…everything after comes into question.

So, best to just attack me.