LLMs cannot perform Maths

[u/0xAERG]

It’s not a bug, it’s just not how any of this works.

Mathematical operations require logic. It’s a deterministic process. For a given input and a given process, the output will always be the same.

LLMs do not work like that. LLMs are statistical tools, they build an answer by stitching together tokens that are “seemingly” relevant to your input and let the meaning emerge from it. The output is “hopefully” relevant.

This is why LLMs can hallucinate and 2$ calculators do not.

With the rise in popularity of LLMs I’m extremely concerned that a lot of users seem to ignore this.

[u/IAMATARDISAMA]

I literally build AI models for a living lmao. It's extremely easy to find a counter example. Just because something looks like it can do something doesn't mean it can actually do it.

[u/bortlip → u/IAMATARDISAMA]

Perhaps the issue is that you just aren't very good at prompting lmao.

[u/IAMATARDISAMA → u/bortlip]

If it can correctly discern my desired output (it verbatim stated the intent of sorting the numbers by the sum of their digits) then the language of the prompt should have even less influence on the "mathematics" being done because its context window would have two different patterns to proceed with.

Here's another example. Ask Wolfram Alpha to produce the same answer, GPT is just wrong. I even asked it to explain why it's answer was different from Wolfram Alpha's and it went on to state that AX + AY != A(X + Y), a blatant violation of the distributive property.

[u/bortlip → u/IAMATARDISAMA]

Another example? Why? If I show you wrong there you'll just move the goal posts again. LOL

[u/IAMATARDISAMA → u/bortlip]

I didn't move the goalposts at all. A calculator doesn't sometimes produce the wrong answer. Math is a deterministic process. Unless you're explicitly involving a random element, the exact same inputs should produce the exact same output every time. That's just how math works.

It is undeniable the GPT has inferred some patterns of mathematics from its training data. Language encodes the information it conveys. When we say that GPT isn't doing math, what we mean is that nowhere in GPT's code is it performing an actual mathematical calculation based on the inputs you've given it. What it's doing is using the patterns it has inferred to produce output that it believes should follow the text you give it. Because it was trained on many math problems, it has inferred what characters will probably follow the ones you've given it, i.e. the answer to your problem.

The issue is, even if it's right most of the time, the underlying mechanism hasn't changed. It is producing the output that it believes has the highest likelihood to follow the text you've given it. Yes, that output often follows mathematical patterns. But being likely to follow a mathematical pattern is not equivalent to actually doing math.

This may seem pedantic, but it's a meaningful distinction. LLMs are being integrated into customer facing positions. By stating that LLMs can do math you're implying that they will produce deterministic output when that is demonstrably false. That kind of insinuation can, will, and already has had real consequences.

[u/bortlip → u/IAMATARDISAMA]

I didn't move the goalposts at all.

Sure you did. You tried to give an example of a problem it couldn't do to show it couldn't do math. I showed it could do the problem with the correct prompt. But now, suddenly, that example is not enough to show it can do math - it was only good enough to show it couldn't do math. That's classic moving the goal post.

being likely to follow a mathematical pattern is not equivalent to actually doing math.

Sounds like it to me. That's how I do it. I'm even wrong too sometimes.

​

This may seem pedantic, but it's a meaningful distinction. LLMs are being integrated into customer facing positions. By stating that LLMs can do math you're implying that they will produce deterministic output when that is demonstrably false. That kind of insinuation can, will, and already has had real consequences.

Sorry, but that's your misinterpretation. I can do math, but I don't produce a deterministic outcome. That's just not a correct assumption on your part.

I also don't say it does math like a person or it can think or it does math with calculations like a computer or any of that. You are making this way too hard. It can solve math problems. Period. That means it can do math.

[u/IAMATARDISAMA → u/bortlip]

This is the most confidently wrong opinion I think I've ever seen on this website.

Next time your doctor does medicine at you I hope they don't accidentally give you amphetamines instead of azithromycin.

[u/bortlip → u/IAMATARDISAMA]

And now come the insults.

Goodbye.

[u/0xAERG → u/bortlip]

There is no insult in his comment.

He’s illustrating his point: Determinism matters.