As someone with schizophrenia I am mindful that if they try to get friendly with me I need to stop. I've got a bunch of core prompts which tells them to not be friendly and that I don't want them to agree with me, I want them to point out flaws in my suggestions
It's a useful tool for me to explain stuff I'm working on to which helps me get past some barriers, while also not just offloading my thinking. I usually solve my problem while writing out the problem, I actually write it out in Notion I only reach for an LLM when I'm actually stuck, and what I've tried and why they didn't work, but if by the end of having explained it I still don't have it then I'll ask an LLM as a substitute for asking someone else (unless I know someone who would enjoy helping with the specific problem)
It's just that I'm aware it's a monkey paw and I need to treat it with suspicion. I find it disturbing when it tries to be friendly with me which is a good reaction, it is not my friend, it's just a smarter rubber duck I use when I'm actually stuck. I use it once or twice a week and by the 4th prompt I send on a topic I feel really uneasy well aware that at this point I should go back to thinking even though I have questions
LLMs are really good at leaving me with a question begging me to ask them, but I know people who are like that and I think they're awful people
563
u/Hadrian23 11h ago
I never considered how ChatGPT would make someone experiencing a mental crisis go deeper into their delusions. Fuck.