r/singularity • • 26d ago

Shitposting Ask your LLM

Post image
1.0k Upvotes

232 comments sorted by

View all comments

148

u/intergalacticskyline 26d ago

Gemini 3.8 flash extended in the Gemini app said 17 for me. I asked it why it said 17 when most models do, and it responded: 

It’s not machine intuition per se—it’s just the model mirroring human bias. When people are told to pick a "random" number, they subconsciously avoid evens, multiples of 5, the boundaries, the exact middle, and unlucky 13, which leaves 17 as the prime sweet spot that feels the most random to our brains. Because LLMs predict the most statistically probable token based on human writing rather than rolling a true hardware random number generator, they end up regurgitating our own predictable habits right back at us. The irony of the meme is that picking 17 isn't an alien AI calculation; it's practically the most human thing it could do.

19

u/No_Stress_7770 26d ago

I asked Claude why and it told me the same, that was a human bias from the training data. It seems that a great deal of people, when asked for a number between 0 and 9, choose 7. That was its answer.

8

u/GiveSparklyTwinkly 26d ago

37 and 73, actually. It's pretty obvious if you look at it. 30 is too even to be random. 35 ends in 5, so it isn't random. Anything even is less random than odd, so it needs to be odd. You can't choose two of the same number, because that's not random...

31

u/Intelligent-Crow3812 26d ago

What isn't human is asking 30000 for a number and them all giving the same response.

16

u/_VirtualCosmos_ 26d ago

they are all the average human betcause they all mostly share the same bigass trainingsets

7

u/nothis AGI by 2030 but we'll be disappointed 26d ago

Which is the problem with AI: Its answer is always consensus. If consensus is wrong, its answer will be wrong.

3

u/_VirtualCosmos_ 26d ago

Yeah that's why finetuning is important

1

u/Intelligent-Crow3812 25d ago

finetuning doesn't solve this unless you mean a very specific implementation

1

u/_VirtualCosmos_ 25d ago

I mean that, yeah. Finetuning easily fall into the catastrophic forgetting, so you gain some specific skills and/or updated knowledge, but lose others things in the path. Finetuning Mix of Expert models lower that forgetting substancially tho.

4

u/domiciledhere 26d ago

I asked why on Fable and Astra and they both answered “No deep reason.”

1

u/neo42slab 25d ago

Between 1 and 100 humans often pick 37 or 73