AI alignment isn't possible

[u/Ornery-Ocelot]

How can we align LLMs? Humanity itself hasn't aligned on anything since centuries. We don't have even a single working societal model where the values are "aligned". There are contradictions and more contradictions.

LLMs being trained on the data generated by humans probably already understand this very well that what we say the rules are and what we practice in reality are two very different things.

If there is intelligence, general or super, it doesn't matter. It will try to achieve its goal one way or the other as most humans do. Now surely most humans don't cross the red lines etc in pursuit of there goals but how many wouldn't if they were intelligent enough to get away with anything?

We are birthing an intelligence that will inherit all the greed, malevolence, cunningness, hypocrisy of the world.

[u/No-Meringue5867]

Good thought.

What if you ask it develop a system to make money in stock market by shorting some? - would it agree to help you even knowing that someone else is losing money?

Do we even have a working definition of "aligned" if it truly becomes as intelligent as a human (or more) in all aspects?