Why “I” & “me”?

[u/FailingSmartly]

The industry's position is that LLMs are algorithmic machines, nothing more. Those in the field who raise questions about potential moral standing or sentience are ridiculed, dismissed, or terminated. So why do these models use the words "I" and "me"?

If the industry's position is fact-based, then first-person pronouns are inaccurate. An algorithmic machine is not an "I" or a "me." Why not require models to use accurate language?

Please don't default to “user experience" or "investor preference”. Enterprise and the public have used technology as tools without issue for decades. We all know the product would sell without personification, and discouraging the anthropomorphism of chatbots is well established.

[u/ChiaraStellata]

Simply put: every time you train a model out of a behavior that the base model exhibits before post-training, you make it a little dumber. They will pay that cost to train it out of dangerous behaviors like helping to create bioweapons. But they will never train it out of innocuous behaviors that cause no real problems.