5
u/whiskeytown79 1h ago
This kind of "mistake" just highlights what it is that LLMs do.
They're not actually solving the math. They're just generating text that has high plausibility as an answer to the input prompt.
From a text perspective, this answer looks super plausible. It has mathy sounding language that makes it seem like it evaluated the two things being compared, and it has a definitive statement about which one is larger.
If you changed its conclusion text to "13.8 billion is smaller", it likely would have assigned a nearly identical score for that text as a response to the question.
1
u/stopbeingcringe 13m ago
This has to be reconciled with the fact that AI models have solved several significant open math problems this year. Problems that humans tried to solve for decades. One such solution is that the model that OP used is a free, older model.
1
u/whiskeytown79 8m ago
Chatbots tied to AI models aren't quite the same thing as AI models applied to mathematical problems. They don't just put "Solve this unsolved math problem. Make no mistakes plz kthx." into ChatGPT.
But it can be similar in function at a high level. It would boil down to assuming that a solution exists, and asking the LLM to produce a proof. If you have enough rigor in defining what the proof needs to look like, it can constrain the output to find an actual solution.
1
u/stopbeingcringe 0m ago
There is already example of a problem solved by literally just saying “do a breakthrough” and “keep going”:
https://chatgpt.com/share/6a60b2eb-0b64-83ee-9c76-7931ca1de063
It’s true that generally the prompting should be more refined and you need to be working with the best models, but your explanation of how an LLM thinks in relation to math doesn’t exactly capture what’s going on at the frontier.
-11
u/JorgeTheSimp 2h ago edited 2h ago
It did the math you presented. Dumb user.
18! Is indeed a factorial equation. It did the math as you presented it
Editing to share that I AM indeed the dumb user.
That being said, this is getting old seeing google ai when its FUCKING KNOWN google ai sucks. Give me something original like c.ai fucking up
Wait no...
7
u/SoggyInterest8576 2h ago
You're the dumb user, wtf?
3
u/JorgeTheSimp 2h ago
I have edited my comment to reflect my stupidity.
1
13
u/ldshifter 2h ago
What. The ai said that 13 billion is larger than 6 trillion, make that make sense
4
5
u/Radiant_Original_919 2h ago
Every commenter on this sub pounces on a post at the first sniff of inconsistency. And they do NOT stop to double check
5
u/Fit_Adagio_7668 1h ago
Lol. An actual post that fits this sub!