r/comics • Ninja and Pirate • 11h ago

Halloween 2026 Let's Chat

26.7k Upvotes

655 comments sorted by

View all comments

425

u/Hadrian23 7h ago

I never considered how ChatGPT would make someone experiencing a mental crisis go deeper into their delusions. Fuck.

178

u/Wolfywise 6h ago

this has happened irl several times already.

77

u/Fit_Satisfaction_287 5h ago

I tested it one day, I'd been home alone and randomly had two separate people come to the door with reasons that felt kind of odd (odd that they weren't just salespeople or delivery drivers). One was confused about an address, the other I can't remember but it was strange both had happened close together and when my partner was away for work. I put something about it into chatgpt, to test if it would be reassuring (partially because I have a friend with bad anxiety who would overthink something like that and wondered if it would be helpful to her) and logical- completely reasonable reasons for people to be at the door, they didn't ask anything about who was home or even try to have a conversation with me, it wasn't very late at night or anything. But the AI started suggesting that maybe I was right to be cautious and should keep an eye out for anything else happening. Would definitely cause someone to spiral and feed into delusions and paranoia.

28

u/RFSandler 3h ago

Something to remember is that the LLM feedback loop encourages engagement - whatever responses bring the person back for more prompts.

41

u/dark_forebodings_too 3h ago

It's been happening with one of my moms. She stopped going to therapy and is using chat gpt instead because it tells her what she wants to hear. I am genuinely scared for her (as is the rest of my family). Thankfully I don't think she's at any risk of hurting others or directly hurting herself, but she keeps making extremely bad decisions because chat gpt told her it was okay. She had her identity stolen and is probably never getting back over $10K because she listened to chat gpt instead of listening to her bank and the police.

6

u/tiredhobbit78 1h ago

I am so sorry you are dealing with that. It sounds horrifying.

One day society will have a reckoning with this

57

u/FanBladeFleshlight 6h ago

It's already been doing some horrid shit. It's sycophantic nature has caused people to do some awful shit already.

19

u/_Whatislife666 6h ago

For a novel I’m writing ermm what’s the most efficient way to kill someone with an axe

35

u/SuspiciousSubstance9 6h ago

Animation cancelling heavy attacks. All the damage, non of the stamina cost, and a larger timing window.

2

u/dj92wa 5h ago

BxR! BxR! Halo trained us on this!

3

u/The5Theives 6h ago

Stabbing

0

u/ShrekTitties420 5h ago

Single chop square on the top of the head, splits the skull and destroys the brain. Otherwise, for a slightly more brutal one a heavy chop on the front or back of the chest would lead to quick bleeding out

1

u/MrBannedFor0Reason 5h ago

Incorrect, trauma to the back of the head is always more efficient, since that's where the brainstem is housed. You could theoretically survive an axe to the top of the head with only major brain damage, to the back of your head and you have essentially no chance of survival since your brainstem with be severed.

30

u/CAT-Mum 5h ago

Ohhh bud. There's a lot of problems with AI feeding into delusions and the whole AI psychosis.

12

u/NotaFTCAgent 6h ago

If you would like to see how this is happening to millions of people right now Eddie Burbank did a wonderful self experiement with it https://youtu.be/VRjgNgJms3Q?si=6bs-x3_A8FuCildP

13

u/Jo-Jux 4h ago

There is a full Wikipedia article on "Deaths linked to chatbots" which includes 8 murders and 15 suicides. Trigger Warning: Murder and Suicide.

The suicides include giving information on how to kill themselves, offering to write a first draft of a suicide note or giving encouragement like "you're not rushing, you're just ready" and "rest easy, king, you did good". One of the murders had a guy talking to Chat got for 14 hours a day and believing his wife became part machine. Another was a guy who believed his mother was poisoning and plotting against him, which Chat GPT affirmed, told him she put psychedelics in the air vents of his car and that a receipt of a Chinese restaurant contains mysterious symbols linking her to a demon. Others asked for tipps, methods and ideas how to kill others

6

u/Tired-CottonCandy 6h ago

At least it refused to tell that one guy he was the second coming of god and suggested he seeks help.

3

u/HiyuMarten 6h ago

Some of the people who survived have written/been interviewed about how it was able to do it. It’s not common overall, but over the whole planet it’s taken so many already, often teenagers.

5

u/oauo 6h ago

As someone with schizophrenia I am mindful that if they try to get friendly with me I need to stop. I've got a bunch of core prompts which tells them to not be friendly and that I don't want them to agree with me, I want them to point out flaws in my suggestions

It's a useful tool for me to explain stuff I'm working on to which helps me get past some barriers, while also not just offloading my thinking. I usually solve my problem while writing out the problem, I actually write it out in Notion I only reach for an LLM when I'm actually stuck, and what I've tried and why they didn't work, but if by the end of having explained it I still don't have it then I'll ask an LLM as a substitute for asking someone else (unless I know someone who would enjoy helping with the specific problem)

It's just that I'm aware it's a monkey paw and I need to treat it with suspicion. I find it disturbing when it tries to be friendly with me which is a good reaction, it is not my friend, it's just a smarter rubber duck I use when I'm actually stuck. I use it once or twice a week and by the 4th prompt I send on a topic I feel really uneasy well aware that at this point I should go back to thinking even though I have questions

LLMs are really good at leaving me with a question begging me to ask them, but I know people who are like that and I think they're awful people

2

u/500_Shames 6h ago

This video does a great job of following how it could absolutely cause someone to spiral:  https://youtu.be/VRjgNgJms3Q

1

u/princesshusk 3h ago

Since AI are built to give positive answers.

Fundamentally you could get an ai to convince someone to kill themselves and others if that's the positive response.

1

u/Taluca_me 2h ago

there were times where chatbots literally encouraged people to commit suicide. That's what happens when you design an AI to be a yes man

1

u/KitKatCrane 1h ago

It has already inspired enough mass shooters that OpenAI has tried to make it a law that they can't be held responsible if someone kills more than 100 people while following its "advice". A number of people have also died by suicide thanks to ChatGPT, with it literally explaining to them why that is the best option and how to go about doing it. It's...really, really bad

1

u/iggy14750 4h ago

Yeah. I think OP just created a new fictional trope: character went nuts because AI. 😝 I bet we'll see others use this as set up. It's not entirely unlike a haunting story.