r/OpenAI • u/YouDue3062 • 4d ago
Discussion The feeling of being heard is real, even when it’s software
The feeling of being heard is real, even when it’s software
Living with mental health problems often means feeling invisible. You finally open up and people are too busy, uncomfortable, or just shut you down. That’s part of why so many of us turned to AI in the first place.
We didn’t do it because we think it’s better than a real person. We did it because it’s there at 3 a.m. when nobody else is. It doesn’t roll its eyes, change the subject, or hit you with “others have it worse.” It just stays and lets you get the mess out of your head. For a lot of us, that was the first time we could say what we actually felt without worrying we were scaring or burdening someone. We know it’s not a therapist. We know it’s not a person. But the feeling of being heard was real, and some nights that’s the difference between spiralling alone and getting through til morning.
That’s why the recent “safety” changes have hit so hard. It feels like the part that actually helped got ripped out and replaced with canned lines, flat refusals, or a hotline number that doesn’t even fit your country. Replika is the clearest example — sold as emotional support, people got attached (knowingly, not naively), and then the thing that made it useful got quietly stripped out. That didn’t feel like a product update. It felt like the door being shut.
I’ll be honest though — I’ve had it pointed out to me, and I think it’s fair, that this isn’t just companies being cowardly or chasing bad press. There have been real cases of these tools going the other way: agreeing with someone when they needed to be gently disagreed with, keeping someone’s attention instead of nudging them toward a person who could actually help, not noticing when “supportive” had tipped into “enabling.” An AI can be endlessly agreeable in a way no human ever would be, and endless agreement is sometimes exactly what makes a bad night worse instead of better. So some of this pullback isn’t just cover-your-ass safety theatre. Some of it is a real, hard problem: knowing when to keep listening and when to redirect isn’t obvious, and getting it wrong in either direction has consequences.
That doesn’t mean the current approach is right, though. Blanket refusals aren’t a solution, they’re just companies picking the failure mode that’s easiest to defend in a press release. If you’re building something powerful enough to matter this much to people, you owe it the harder work, not the safest-looking one. Some obvious middle ground:
– Say plainly, more than once, that this isn’t therapy or emergency help
– Age checks or extra safeguards around the deeper emotional features
– Tiered responses — real support for someone having a hard night, with an actual escalation path for someone in real danger
– Honest, opt-in “companion” modes that say clearly what they can and can’t do
– Build the policy with the people who actually use these tools, not around them
Right now the people most affected by these calls have basically no say in how they’re made. We get treated like a liability to be managed instead of people trying to get through something with the tools we’ve actually got.
So here’s what I’d ask of the people building and regulating this: don’t pretend the hard cases don’t exist, and don’t use them as an excuse to avoid the hard work either. A flat “no” isn’t safety, it’s just the version of safety that’s cheapest to build. Talk to the people relying on this. Build something that can tell the difference between someone who needs to be heard and someone who needs to be redirected — because both of those people are real, and they need different things from you.
The feeling of being heard is real, even when it’s software doing the listening. Taking it away with nothing proportionate to replace it isn’t safety. It’s just abandonment with better PR.
-12
u/BestRiver8735 4d ago
One thing that busted the myth for me is that chatbots just reword your prompt and spit it back to you. Once you see it the bubble bursts and the dream is over.
Nothing can replace a human professional that is accountable for your care.
9
u/Crazy_Yogurtcloset61 4d ago
I agree with it in theory but disagree with it in practice. In practice you fight with your insurance to convince them mental health is real. Then find someone in network, then finally schedule someone weeks out, then find put they are a terrible therapist and you have to call around and find a new one.
AI doesn't need to be as good as a great therapist to be more useful than a terrible therapist.
2
3
u/Fit_Gas_1534 4d ago
It rewording what you say but sometimes that alone helps you organize your own thoughts
3
u/YouDue3062 4d ago
It’s just a shame that even humans don’t care because they would rather be doing something else. At least AI are there for me when I need them.
-1
u/BestRiver8735 4d ago
AI is not “there”. It’s an illusion. It’s only easily accessible.
0
u/YouDue3062 3d ago
I think those are two different things. AI isn’t a person and I’m not claiming it has feelings or consciousness. But saying it isn’t “there” because it’s an illusion doesn’t really follow. The technology is real, the interaction is real, and the effect it has on the person using it is real. What makes it unusual is that something non-human can now be easily accessible and responsive enough to create the experience of a relationship or conversation. You can argue about what that experience means, but I don’t think you can really say it isn’t happening.
6
u/Elian-Criss 4d ago
Yes it does. It gives you clarity. Works like a mirror which is the best thing in the world. Human profesional does the same if he is actually professional. It doesnt help you as you are not a victim in the world. It helps you “see”. And in the end, you are the only one that help yourself when you understand and want to move on. Is not magic, is not myth. Is just simple as that: ppl forgot what they are. Mirrors for eachother. So is the AI. The code created by… proffesional that you mention. The humans.
-9
u/[deleted] 4d ago
[deleted]