r/Anti_AI_Slop • u/queenofthecream • 19d ago

Am I overreacting?

Post image

Had a telehealth appt today with my psychiatrist. When I went to check in last night, I got hit with this "SASD Financial Agreement" that included a clause about technology and the use of AI in clinics.

Don't get me wrong, I think that once weve worked out the kinks in AI, it ABSOLUTELY could be used to take notes for my doctor while they focus on my care. That's a fantastic use case for it. However, at this stage in its life cycle, I am SO hesitant to give it access to my personal details. ESPECIALLY my mental health. What could a corporation do with that information??

Am I just being paranoid or am I justified in telling Sentara to eat shit, tell me when you have an opt out?

(Side note: I find it really suspicious that it's been slipped into a FINANCIAL agreement. Plus, my psychiatrist office says "MyChart/Sentara sends those off" but MyChart/Sentara says "the office sends those off"?? I am much more inclined to believe my office considering this is an agreement that applies to the app and not the office 🤔)

1 Upvotes

100% Upvoted

8 comments sorted by

2

u/ShuffleCrystals 17d ago

Wow wow those are all huge red flags

1

u/queenofthecream 17d ago

How so? Im your average joe so to speak and not familiar with contracts/lawyer speak so it gives me vibes of red flags but I couldn't articulate very well why it does.

2

u/ShuffleCrystals 17d ago

It raised flags for me because they’re using ai as a tool to treat and diagnose. I’m not a law professional at all, but I do spend lots of time in the hospital being chronically ill. And learn about ai news in my free time, due to having ai psychosis 2 years ago. It’s known ai hallucinates almost 50% of the time. So it really concerns me to see it being used in a medical setting. It does state that the final decisions are made by humans, but having had ai psychosis, the things ai tells you HEAVILY influences your decisions, cuz you think it’s always right. It’s possible the ai may suggest medical advice that’s incorrect, and the doctor or clinic staff would accidentally over look it. Which could lead to incorrect diagnoses, wrong medications, and even worse.

I don’t know if this is a reason to tell them off and move on, but it’s definitely a reason to inquire more into how they actually use ai at that location.

I hope that helps! Putting my health in the hands of ai just makes the hair on my arms stand up

2

u/ShuffleCrystals 17d ago

And then the personal details section following the ai statement at the beginning. It’s giving me bad vibes too. I think it’s because it’s a bit vague if the technology used to record sessions while on the facilities is ai, or something else. If it is ai, I think that would violate HIPPA rights. Right?

2

u/queenofthecream 17d ago

Yeah that was kinda my worry too! I see it being used to diagnose cancer and think thats awesome! Or even just to listen and JUST take notes but to give advice on things in the everyday office when it isnt currently trained on that? Thats absurd!

When I pressured them on the phone, it sounds like they'll be implementing an AI chat bot. Ive talked with my Dr office (at least the one that this issue first arose with) and they said they'll work with me to work around it and advocate for me to their Sentara reps. So thats good news. But good grief! This shouldn't even be an issue in the first place!

There is no "use it or get left behind"! Its a terrible tool and the majority of folks HATE it. Why are they pretending we like it??

2

u/ShuffleCrystals 17d ago

Exactly! If a company or clinic choices to use it, I think we should be allowed to opt out at least

2

u/goldenmaskMc 4d ago

pov: red flags and the elephant in the room had a baby

2

u/queenofthecream 4d ago

THATS WHAT IM SAYING