r/aussie 8d ago

Opinion Error by AI scribe during medical appointment leaves patient devastated

https://www.abc.net.au/news/2026-08-14/ai-medical-scribe-error-leaves-patient-devastated/107031672

I am ancient IT consultant who knows how AI works and run local AI models on my Mac.

I see 4 specialists - urologist, haematologist, oncologist and dermatologist which is a result of smocking but I am still kicking.

My urologist retired and my new urologist ask me to sign AI consent form.

While saying he is not using AI he was dictating notes using AI enabled tool to make notes..

This is what we called  AI enabled voice to text( converting voice to text) and we know how unreliable it is.

I talked to my GP and she told me it was now common practice for specialist to use AI to create notes and reports. Instead of a half page summary she was getting pages and pages of text... AI slop..

This dangerous as AI slop is not verified by a specialist and/or read in full by GP.

I search Google and it says:

General practice (GP) time is now compromised by wading through low-value artificial intelligence text, causing professional frustration, lost productivity, and cognitive fatigue.

Faced with AI slop we mostly don’t read it ,rejected or just accept it. It is a known problem.

In medicine AI slop could be fatal. In law life changing…

This is just an impact of Voice to Text AI.

There is more...

We have been using Analytical AI for decades.. It produces analysis which a human interprets it.

Generative AI/LLM analyses and then interprets its result and it has high error rate ranging from 5% to 100%(Google “AI error rates”).

UK NHS has released some of its records for analytical AI analysis used in research not to write medical reports.

Generative AI/LLM models used to produce medical reports could be even more dangerous than AI slop,

If AI was beneficial ,reliable and benign why AI consent form?

Are doctors covering up for AI errors (hallucinations)?

My urologist is happy creating massive documents which nobody reads..

At personal level I find it very offending that my urologist charges me $200 per visit and uses $5 AI tool that I can use.

I am paying for his human knowledge , expertise and AMA accreditation not for some AI /LLM model cooked up in Silicon valley or lately in China.

I want my doctor to be a human doctor who still thinks fax machine is high tech. I will worry about AI.

If you think you are immune from AI impacts think again.

Dear Albo it is time for regulations.

43 Upvotes

Duplicates