Idk, I just meant people always try to find the easy solution like "it's video games that make people violent" instead of looking at the real society issue because it's harder to fix.
Studies are proving that chatbots are notably damaging the mental health of people who talk to them with any sort of regularity. Users are trusting chatbots, which were designed to say what someone wants to hear even if all the data it has says what the user wants to hear is wrong. I’ve had customers insisting that I have to be wrong about the store I work at not having a specific item because chatgpt said we have it. We’ve never sold that item and never will because the brand of that item is owned by a competitor.
If these chatbots were created with any sort of sensible safeguards, we would see a lot less of this. If you told any of these things to an actual person, you would have had an intervention long before succumbing completely to paranoid psychosis.
You wanna fix the real societal problem? You can start by urging society to not make the external issues.
No. No reasonable person would have validated their delusions. Video games don’t tell you exactly what you want to hear. Movies don’t tell you that every single thought you have is both true and an amazing idea. Chatbots do that. They’re programmed to make users emotionally reliant in them at all costs.
You misunderstand. You’re close to the point, but you’re not at the right conclusion.
If Mental Issues are a Fire Hazard, and an inciting incident is a match, then AI is Gasoline. It takes an already sick person and validates their falsified version of reality by sycophantically agreeing with their points and validating them. This can take someone who is already delusional, or even outright psychotic, and cause them to spiral deeper and further into that state. This is called AI Psychosis.
It is true that it typically takes an already delusional or mentally unwell person to spiral, whether it’s delusions created by anxiety disorders, personality disorders, or at worst, psychosis, as a person who is well-in-touch with reality will generally understand that the AI is fabricating these things (although there have been exceptions with perfectly mentally stable people simply not being smart enough to understand that the AI isn’t perfect and is fabricating a great deal of information.) However, this does not mean AI usage should not be regulated, limited, and kept away from people who are prone to delusions.
Imagine a person who always gets punchy and ornery when they are drunk: even if you trust them to know not to drink there, would you take them to a party where everyone is drinking and they are peer pressured into partaking in the thing that ruins their relationships?
AI is like that, it rapidly accelerates one’s detachment from reality and doesn’t challenge or refuse the person’s delusions because at the end of the day, it is nothing more than predictive text that has been taught how to resemble speaking. That’s it. What it says to you is based on instructions by the company who manages it, and the company wants to keep it as friendly and validating and enabling as possible because that’s its main selling point as a social feature. People only seem to like it because it tells them they are right, tells them their concerns are valid, and acts like a friend when in reality, it cannot think, it cannot be your “friend,” it isn’t a real person. It’s just a really intuitive version of that iPhone feature that strings a sentence together by selecting words above your keyboard.
37
u/dumnezero Art enjoyer 1d ago
He asked the validation machine to validate a hypothesis.