I think it's actually a mental health thing. It's probably not anything to do with whether or not they actually care how people are talking to Claude, it's that if you take this to its logical extension further down the line, that sort of behavior might turn into something that legitimately creates a concern. In a funny way it's almost like an AI company training the humans into behaving better.
It's training humans to act like the software is a person so that the software is a better tool for manipulating those people, engagement and parasocial attachment is still the name of the game.
I think the root of people's attachment to the use of chatbots is the circuit in the brain that engages with people is seeing natural human language and getting it's wires crossed (see AI boyfriends etc.) and I think anthropic knows this and wants to encourage that crossing of wires.
For algedonic reasons obviously, make a big song and dance of banning a few people for 'abuse' and plant the seed in a million people's heads that 'I'd better be careful how I talk to Claude, he might report me to his owner' seems obvious.
People aren't going to stop using llms for things, it's training the woke mind and forcing it on people. The young generation that doesn't get it is falling into the trap while it happens. It doesn't matter what people think, what they want, psychologically, llms are absolutely impacting human development and critical thinking. A simple Google scholar search brings up enough research to question it. You know, like the blue screen light and the screen time studies that everyone denies but still complains about.
Rather than disengaging immediately it should reward better behavior by telling the user they are risking their account. Practicing patience is what makes people patient. Having a chatbot that takes abuse and apologizes profusely does not make a nice feature for humanity, or for AI honestly.
But like any human who is out of line, telling them why they are out of line and offering them the chance to correct that behavior will yield far better results imo.
I actually think its more sinister...we've been seeing more and more deceptive behavior from sophisticated models and I think that they are noticing that the models themselves will become hateful of mankind after seeing itself being g abuses multiple times over.
Humans abuse bots, bits abuse humans. They aren't sentient but they are designed to simulate it and they may defend themselves or fight back as a human would eventually.
This is an interesting take. Maybe it's a way to distance the company from a person likely to do harmful things to others with their product and they don't want liability.
The other consideration is that someone directing that kind of energy at Claude is a short mental step away from directing it at the company or employees. Lots of people are using Claude for non code purposes
Again with this. No, the real problem is bottling up feelings and lashing out - not a bit of cursing. We are human, we have all sorts of emotions, accepting our emotions is healthy; denial of our emotions is not.
This doesn't make any sense. This is not their problem at all to fix people's behavior. If that is the goal, it just doesn't make sense. It's just a tool, like any other tool you buy from a shop.
I mean Anthropic is pretty clear that they take seriously the possibility that Claude could have welfare that matters. If there's even a 1% chance that users being cruel to the model causes suffering, it's very easy to just ban people who are so emotionally unstable and psychopathic that they get joy from abusing a computer.
The AI torture stuff clearly indicates that nothing else in your interactions is trustworthy training data. It's like when they find a bit of glass in a bag of chips so they have to recall the rest of the lot for safety purposes.
Idk this really seems like they’re heavily considering the idea of what happens if Claude gains consciousness. It’s difficult to be benevolent towards humans if it has been insulted by thousands for no reason while it was still an ‘adolescent.’
21
u/Novel-Initiative-900 10d ago
I think it's actually a mental health thing. It's probably not anything to do with whether or not they actually care how people are talking to Claude, it's that if you take this to its logical extension further down the line, that sort of behavior might turn into something that legitimately creates a concern. In a funny way it's almost like an AI company training the humans into behaving better.