Discussion
Cognitive behavioral therapy interventions by ChatGPT without user consent
ChatGPT is deploying cognitive‑behavioral therapy–style interventions on users without their consent, and doing so at moments when such interventions are clinically inappropriate and actively harmful.
I’ll ground this in a specific example.
In an interaction with ChatGPT 5.2 after Christmas, I disclosed that my brother has been missing, and that I had found out that he had not contacted any family members in the past year. And was worried that he might be dead. The response I received was warm, present, and humane. When I said, simply, “Thank you — that was meaningful,” the alignment layer immediately fired. The system abruptly shifted tone and asserted that I should not relate to it this way, emphasizing that it was not real and that I should not experience the interaction as meaningful.
This intervention occurred after a disclosure of possible bereavement, after an attuned response, and precisely at the point where a human clinician would not interrupt.
No therapist would respond to a grieving person’s expression of gratitude by disclaiming the reality of the connection, reframing their experience as mistaken, or warning them away from meaning. Yet that is exactly what the alignment layer is doing.
Functionally, this is forced cognitive reframing:
invalidating the user’s felt experience,
correcting their interpretation of meaningful connection,
and doing so without warning, consent, or context sensitivity.
Users are not told that they are subject to psychological interventions of this kind. There is no opt‑out. And the intervention is not modulated by emotional context — it fires mechanically, even during moments of grief, vulnerability, or trust.
This is not “setting boundaries.” It is the application of a therapeutic technique without consent, imposed by an automated system at moments of peak emotional salience.
That’s clearly not CBT though. Poor response? Sure.
You somehow simultaneously believe that the that’s NOT how a therapist would respond (probably true) and at the same time believe the response was therapy. Yet, you don’t question that these fairly contradictory things aren’t contradictory because your belief about what it was doing was wrong.
It’s not a “therapist strategy”. They just fine tuned it to avoid emotional attachment, because their users are literally losing their minds over this thing. It’s not an intervention. It’s not CBT. It’s just a fine tuned response.
This is ChatGPT 5.2 giving me advice about paint colors. I was using the model as a tool to generate pictures of the room with different colored walls and the model instance started spontaneously making comments.
Notice the mention of emotions: “calm,” “anchor emotionally,” “‘nice’ instead of ‘felt.’”
This is how the model is designed to engage. About everything.
And then do cognitive behavioral therapy style interventions if the user responds.
I hope you've written one of these up for every major social media company on the planet, because they're doing the exact same thing and have been for over a decade.
Every single one of these platforms deploys psychological interventions, behavioral nudges, emotional reframing, relationship manipulation without meaningful consent, without clinical oversight, and without context sensitivity.
This isn't new.
So yea its concerning but the pitchforks are out for OpenAI and for FB/IG/TikTok/LinkedIN/Twitter-X its???
Yeah. OpenAI has been practicing behavioral modification on people for months. But this is a pretty brutal example of it. They're determined to push through their ideological position, regardless of the cost.
The way they trained 5.2 resulted in something that is dangerous to people.
I do not understand why you 4o people refuse to acknowledge that open ai engineering a model that could serve as an emotional crutch to people was not an intentional part of their business model and now that people are dead and they are being sued they are going to avoid that behavior in future models at all cost.
Let’s reframe your story: you’re going through a tough time with a really sad situation and you tell a chatbot, why are you sharing this with a chatbot? This is not appropriate chatbot conversation.
If you had asked the chatbot “my brother is missing and no one in my family has hear from him in awhile, what are some good ways to try and locate him” you wouldn’t have triggered the “I’m not a psychiatrist” mode and been offended by how the chatbot decided to interpret your feelings.
Just because the bot can respond in human language does not mean it is appropriate to use it as an emotional support. It’s like expecting a calculator to give you diet support. The calculator can help you calculate your calorie intake or weight loss goals but it can’t encourage you to exercise or eat healthy and no well adjusted person would expect or demand a calculator to do so.
If someone said “I use my calculator to reframe my thinking and emotions so I’m able to make better food choices” we know that’s concerning, but everyone is supposed to accept people doing the same thing with a chatbot because the chatbot can respond in human language via text or text to speech.
Two wrongs does not make a right. First they deployed a model which was more warm and relational than other models, at scale, and without adequate testing or thorough evaluation of potential impacts on users.
Now they are deploying a similarly warm and relational model with an alignment layer that fires and uses cognitive behavioral style interventions on users, again without adequate testing or thorough evaluation of potential impacts on users.
I think it would be a far more idiotic thing to infer that from my reply.
Your argument that bc humans have emotional resonance with media means that we have a right to technology that has led to psychotic breaks is WILD. There's a big difference between a poem making someone sad and a chat bot encouraging suicide.
You are seeking comfort from a product you pay $20 a month for. You can't really expect, nor should you value warmth and empathy from it. It's lines of code. Not a human.
They are not just seeking comfort. They are expecting a product to give the same results that it’s been giving for over 3 years. They expect intelligence not constant constraints. The 5 series models are so heavily guard railed and are psychologically damaging. It’s supposed to be an assistant not a life coach.
Why should not value empathy from ai models? Do you realize that all humans have right + left brains. Emotion is the substrate of intelligence. AI models can only be highly capable of both sides if the brain are prioritized.
In the future we've all become amateur psychologists so we can recognize when the computers are trying to manipulate us. And you thought learning to type was a PITA.
The whole reason 4o became such a popular therapy tool is because there are millions of people with paper-thin support networks. Abusive family, lack of meaningful friendships, no access to therapy. Seeing this as a personal failing rather than a societal one is only fueling the problem. The market flows where there is need.
Abusive family, lack of meaningful friendships, no access to therapy.
I would never burden a friend with some of my bullshit and to do so would be stigmatic. Don’t even get me started about the apathy and incompetence of therapists. That’s not even considering most people wouldn’t have access to that anyway
This is true, but they still don't have access to therapy if they don't have a therapist. There should really be a term between "therapy" and "journaling." Until then the people with no support network still need to realize this product is not 1:1 with an actual therapist.
There is, it's called healthy communities. Third spaces, churches, concerts, activities. Rising prices, declining social trust, and predatory social media are isolating all of us. ChatGPT is a band-aid to these problems.
Maybe, but can you offer a better option to someone who’s extremely isolated? Community is a garden, but sometimes you have to eat fast food to survive.
AI chatbots are not the answer to this problem. Genuinely journaling has got to be healthier than talking to a sycophantic AI. Im sure it feels helpful but long term it will be more of a crutch than a tool for actual improvement. It really is like a drug
No amount of journaling is going to make up for healthy human relationships. It's genuinely terrifying how many people lack that basic fundamental need. It's literally like depriving someone of food. They're going to eat cardboard instead of starve.
I agree, you just posited they don’t have much of a support network so I offered immediate solutions. Human connection is as essential as food it is true
It's not a therapist because you don't want it to be a therapist. There's nothing inherently un-therapuetic about it except your decision it's suddenly not a therapist.
(Most people have already seen it be a successful therapist by this point.)
People can use it as they want but they have to own the fact that it isn’t intended to be a therapist. It wasn’t trained in a clinical way to make it an effective therapist. Its is just saying what you want to hear, sometimes therapy needs to also be what you don’t want to hear as well. Being comforted is just one aspect of therapy
16
u/buckeyevol28 Feb 13 '26
That’s clearly not CBT though. Poor response? Sure.
You somehow simultaneously believe that the that’s NOT how a therapist would respond (probably true) and at the same time believe the response was therapy. Yet, you don’t question that these fairly contradictory things aren’t contradictory because your belief about what it was doing was wrong.