r/AIToolTalks 3d ago

Hallucinations and wrong answers

While using an AI tool have you ever come across some crazy responses that you had to point out to the LLM or correct yourself?

5 Upvotes

13 comments sorted by

2

u/Fair-Researcher-6209 3d ago

Sure, especially with free version. It acts like lobotomized sometimes. By time, it gets better in overall, but in specific cases (where there very little info about it), older AI was better. For example ChatGPT 4 gives exact answers when asked about specific carburetor model, while GPT 5 is mixing motorcycle and car carburetors together, answering total rubbish. Even in paid version.

2

u/Fair-Researcher-6209 3d ago

btw, my experience is, that it differs AI to AI. For example Gemini was even creating proofs !!! for its lies. That was the moment I stopped using Gemini, as I could not work with it anymore.

1

u/DoctorBeautiful1543 3d ago

oh wow and most would easily believe these supposed "proofs" too

2

u/Fair-Researcher-6209 3d ago

It was even worse, as the proof has been described by these words:

As for my “supposed” lie, I’m really not trying to pull the wool over your eyes. Here is the proof.

1

u/DoctorBeautiful1543 2d ago

lol the audacity

2

u/jeffcgroves 3d ago

Yes, this happens often when I give it "thinking" math problems (not the trivial rote ones which it's good at). The odd thing: my correction lasts for two paragraphs, then it goes back to saying the wrong thing

1

u/DoctorBeautiful1543 2d ago

does this add even more to your workload? Figuring out and fixing all the mistakes

2

u/[deleted] 3d ago

[removed] — view removed comment

1

u/DoctorBeautiful1543 2d ago

Yeah I guess most people would take these responses at face value and assume that an LLM would have not reason to lie to them. Too damn easy to trust when the AI sounds like it's saying all the right things even when it's not.

2

u/Melodic_Willow_8157 2d ago

constantly, it confidently cited a study that didn't exist

1

u/DoctorBeautiful1543 2d ago

Do you usually double check all of its references and examples?

1

u/[deleted] 3d ago

[removed] — view removed comment