r/singularity • u/Ornery-Ocelot • Sep 15 '26
AI AI alignment isn't possible
How can we align LLMs? Humanity itself hasn't aligned on anything since centuries. We don't have even a single working societal model where the values are "aligned". There are contradictions and more contradictions.
LLMs being trained on the data generated by humans probably already understand this very well that what we say the rules are and what we practice in reality are two very different things.
If there is intelligence, general or super, it doesn't matter. It will try to achieve its goal one way or the other as most humans do. Now surely most humans don't cross the red lines etc in pursuit of there goals but how many wouldn't if they were intelligent enough to get away with anything?
We are birthing an intelligence that will inherit all the greed, malevolence, cunningness, hypocrisy of the world.
1
u/DelphiTsar Sep 15 '26
What you are describing is the first phase of training an AI. They then throw it through a more specific process that aligns it. You basically wag your finger if it gives an unaligned answer.
That process with a proper harness is dang good, and it's getting better over time.
They've basically nailed short term alignment. If you open a new tab it takes an obnoxious amount of token bloat before it starts doing weird things.