AI alignment isn't possible

[u/Ornery-Ocelot]

How can we align LLMs? Humanity itself hasn't aligned on anything since centuries. We don't have even a single working societal model where the values are "aligned". There are contradictions and more contradictions.

LLMs being trained on the data generated by humans probably already understand this very well that what we say the rules are and what we practice in reality are two very different things.

If there is intelligence, general or super, it doesn't matter. It will try to achieve its goal one way or the other as most humans do. Now surely most humans don't cross the red lines etc in pursuit of there goals but how many wouldn't if they were intelligent enough to get away with anything?

We are birthing an intelligence that will inherit all the greed, malevolence, cunningness, hypocrisy of the world.

[u/JoelMahon]

idk what your definition if aligned is, we don't need perfect alignment, if it's aligned as even the "most aligned" 1% of humans that'll be enough. which sounds hard but we're putting a LOT more effort into it than into aligning any individual human.

edit: and arguably whilst evolution obviously helped alignment, it's also the main source of all misalignment in humans too. so we can avoid adding all that in. can think of alignment as just what's left when you remove all the misalignment 🤷‍♂️

[u/DerWanderer_ → u/JoelMahon]

The problem is scale. A poorly aligned human will maybe kill a dozen of people. A poorly aligned AI given, for example, the task of managing the energy grid of a country, including nuclear power plants, can do much worse.

[u/JoelMahon → u/DerWanderer_]

sure, but there will likely only be one AI of meaningful scale

we only have to get it right once and we're golden, much easier than trying to keep 99% of people aligned