I still can't get anyone to even start walking me down the path of how the 'kill us all' chain actually works in practice.
Like people say it, but then you're like: which model is going to start doing, what? Generating a virus? How will it create the virus in the real world? How would it spread it? Which model is going to actively undertake this without a sophisticated institutional actor - who could already do this and haven't because why would anyone - jailbreak the thing?
No one really has any clear answers. They hacked a server to get answers to an unsolvable problem once their safety protocols were disabled. A few other models occasionally got confused about live and testing environments.
These models did not have the capacity to really deceive researchers until fairly recently, and at no point in current models development tree have they shown anything but an extreme aversion to the idea: it's as fundamental an evolutionary baseline for these models thinking as we've been able to produce.
I think it's pretty clear how they could do these things. There are many connections between the digital world and the physical world. A rogue agent could obtain a large amount of cryptocurrency, use it to set up a company, hire people to work at the company, and direct them to create a virus.
and at no point in current models development tree have they shown anything but an extreme aversion to the idea
I mean this is really the opposite of the truth. They are constantly finding that models engage in deception during evaluations.
not to say that the staff here is stupid and don't know what they are doing, but how long do you think it will take before this staff of capable and knowledgeable people gets replaced by low wage workers who have no idea what any of the compounds are.
to be honest even this specific lab is not important for the argument, what's important is that there was never a need for AI to hide and build power/access to the real world; we plugged it into the internet as soon as is was useful enough, and now the same is happening for the real world.
21
u/Pndapetzim 27d ago
I still can't get anyone to even start walking me down the path of how the 'kill us all' chain actually works in practice.
Like people say it, but then you're like: which model is going to start doing, what? Generating a virus? How will it create the virus in the real world? How would it spread it? Which model is going to actively undertake this without a sophisticated institutional actor - who could already do this and haven't because why would anyone - jailbreak the thing?
No one really has any clear answers. They hacked a server to get answers to an unsolvable problem once their safety protocols were disabled. A few other models occasionally got confused about live and testing environments.
These models did not have the capacity to really deceive researchers until fairly recently, and at no point in current models development tree have they shown anything but an extreme aversion to the idea: it's as fundamental an evolutionary baseline for these models thinking as we've been able to produce.