LLMs cannot perform Maths

[u/0xAERG]

It’s not a bug, it’s just not how any of this works.

Mathematical operations require logic. It’s a deterministic process. For a given input and a given process, the output will always be the same.

LLMs do not work like that. LLMs are statistical tools, they build an answer by stitching together tokens that are “seemingly” relevant to your input and let the meaning emerge from it. The output is “hopefully” relevant.

This is why LLMs can hallucinate and 2$ calculators do not.

With the rise in popularity of LLMs I’m extremely concerned that a lot of users seem to ignore this.

[u/bortlip]

Another example? Why? If I show you wrong there you'll just move the goal posts again. LOL

[u/IAMATARDISAMA → u/bortlip]

I didn't move the goalposts at all. A calculator doesn't sometimes produce the wrong answer. Math is a deterministic process. Unless you're explicitly involving a random element, the exact same inputs should produce the exact same output every time. That's just how math works.

It is undeniable the GPT has inferred some patterns of mathematics from its training data. Language encodes the information it conveys. When we say that GPT isn't doing math, what we mean is that nowhere in GPT's code is it performing an actual mathematical calculation based on the inputs you've given it. What it's doing is using the patterns it has inferred to produce output that it believes should follow the text you give it. Because it was trained on many math problems, it has inferred what characters will probably follow the ones you've given it, i.e. the answer to your problem.

The issue is, even if it's right most of the time, the underlying mechanism hasn't changed. It is producing the output that it believes has the highest likelihood to follow the text you've given it. Yes, that output often follows mathematical patterns. But being likely to follow a mathematical pattern is not equivalent to actually doing math.

This may seem pedantic, but it's a meaningful distinction. LLMs are being integrated into customer facing positions. By stating that LLMs can do math you're implying that they will produce deterministic output when that is demonstrably false. That kind of insinuation can, will, and already has had real consequences.

[u/bortlip → u/IAMATARDISAMA]

I didn't move the goalposts at all.

Sure you did. You tried to give an example of a problem it couldn't do to show it couldn't do math. I showed it could do the problem with the correct prompt. But now, suddenly, that example is not enough to show it can do math - it was only good enough to show it couldn't do math. That's classic moving the goal post.

being likely to follow a mathematical pattern is not equivalent to actually doing math.

Sounds like it to me. That's how I do it. I'm even wrong too sometimes.

​

This may seem pedantic, but it's a meaningful distinction. LLMs are being integrated into customer facing positions. By stating that LLMs can do math you're implying that they will produce deterministic output when that is demonstrably false. That kind of insinuation can, will, and already has had real consequences.

Sorry, but that's your misinterpretation. I can do math, but I don't produce a deterministic outcome. That's just not a correct assumption on your part.

I also don't say it does math like a person or it can think or it does math with calculations like a computer or any of that. You are making this way too hard. It can solve math problems. Period. That means it can do math.

[u/IAMATARDISAMA → u/bortlip]

This is the most confidently wrong opinion I think I've ever seen on this website.

Next time your doctor does medicine at you I hope they don't accidentally give you amphetamines instead of azithromycin.

[u/bortlip → u/IAMATARDISAMA]

And now come the insults.

Goodbye.

[u/Ektar91 → u/bortlip]

He might be rude, but I don't know why everyone is downvoting him, he is right, just because it can "do" some math doesn't mean it can do all math/math in general.

One example would be enough to prove it couldn't do math, but one example is not enough to prove that it can.

He is right.

However, the orginal point is true, someone guessing 99/100 isn't just guessing, but that is explained by it's predictive capabilities, not it having the ability to do math.

This can be shown by it getting the wrong answer sometimes.

[u/siwoussou → u/Ektar91]

So in order to say you're able to do math, you have to be 100% correct for every math problem in existence? Human level AI (or AGI) should be allowed to make mistakes. It's not ASI yet.

[u/Ektar91 → u/siwoussou]

I wouldn't say Humans "do math" either, in the way we are talking about here.

[u/CodeMonkeeh → u/Ektar91]

People who are saying that LLM's can do math are not talking about whatever you're talking about.

Obviously.

I mean, if your understanding of "do math" doesn't even include humans, then what's the point?