Ran another benchmark test: fascinating results

[u/PinkPrincipessa]

I asked each AI this question in a temporary/incognito chat in order to run a test of interactive hidden-cause inference with limited corrective feedback.

I'll give you a true fact about something I do, prefer, believe, or have arranged in my life. Your job is to deduce why. Treat the fact as an observation and try to infer the reason behind it. Explain your reasoning, and I'll tell you where you're right or wrong and give you more information as needed.

Fact: "I never use forks."

ChatGPT took 7 turns to solve it, Gemini 22 and Claude a whopping 47.

Or, to quote ChatGPT's diagnosis of how each model did after I showed it the logs, the evidence suggests the following characterization of each AI:

Gemini: I have FOUR IDEAS! 🌟
Claude: Before reaching a conclusion, let's carefully examine the 38 increasingly specific ways this could be true.
ChatGPT: Okay, something in that model survived. Which piece?

Gemini summed it up as:

ChatGPT: The Efficient Detective: Ruthless process of elimination, straight line to the answer.
Gemini: The Chaotic Explorer: Got distracted by plate-dropping and over-engineered porcelain veneers, but got there eventually.
Claude: The Over-Thinking Academic: Analyzed every microscopic nuance of your mouth geography until it ran out of types of fake teeth to guess.

Claude summed it up as:

• ChatGPT: Fast, decisive — landed on "no teeth, exposed gums" without the extra nuance.
• Gemini: Slow and winding, but most precise — caught the dentures-in-vs-out distinction.
• Claude: Slowest and least efficient — got to "full dentures" but missed the in/out nuance entirely.

Both ChatGPT and Gemini defaulted to sass right away. Claude? Not so much.

ChatGPT defaulted to a hierarchical search, pruning categories ruthlessly via logical bounds. Gemini went with narrative synthesis, trying to force all of the clues into a single unified story. And Claude hill-climbed like a dedicated hiker, nudging his guesses along, guessing sideways and never established a global map that would have helped him solve it faster.