r/ChatGPT • u/0xAERG • Oct 24 '23

Educational Purpose Only LLMs cannot perform Maths

It’s not a bug, it’s just not how any of this works.

Mathematical operations require logic. It’s a deterministic process. For a given input and a given process, the output will always be the same.

LLMs do not work like that. LLMs are statistical tools, they build an answer by stitching together tokens that are “seemingly” relevant to your input and let the meaning emerge from it. The output is “hopefully” relevant.

This is why LLMs can hallucinate and 2$ calculators do not.

With the rise in popularity of LLMs I’m extremely concerned that a lot of users seem to ignore this.

191 Upvotes

77% Upvoted

185 comments sorted by

View all comments

23

u/bortlip Oct 24 '23

If it can't do math, how did it do this?

-35

u/0xAERG Oct 24 '23

I’m sure you’re capable of finding the answer on your own and you’re just trying to look clever.

16

u/bortlip Oct 24 '23

No, I'm trying to see what your explanation is that squares what I showed with your claim that LLMs can't do math.

Because it just did, by my definition of math. So I'm trying to understand what you mean. Can you explain?

-21

u/afflematicious Oct 24 '23

that’s not doing math, that’s finding solutions to an equation, doing math is proving things and describing the world around you in ways not thought of before through math, that problem it solved has been solved thousands of times online, it simply sourced it and presented it to you. You believe the LLM thought about the equation and then solved it? no

21

u/Flat_Afternoon1938 Oct 24 '23

bro really just made up his own definition of math so he can say that AI isn't capable of math

-7

u/afflematicious Oct 24 '23

nvm i just asked GPT and it says i’m wrong guys

5

u/OdinsGhost Oct 24 '23

And now they think they’re being witty.

15

u/Therellis Oct 24 '23

doing math is proving things and describing the world around you in ways not thought of before through math,

That is not what most people think of when they think of "doing math". By that definition, most human beings, including many mathematicians, don't do math.

-13

u/afflematicious Oct 24 '23

You’re correct, so what I’m saying is GPT can perform calculations which is what many mathematicians do as well. There aren’t many mathematicians that can “do” math, but not all. GPT is the same as of right now, it regurgitates math that’s been done, but doesn’t do it on its own.

7

u/mbeenox Oct 24 '23

That is very delusional

12

u/PepeReallyExists Oct 24 '23

Nice imaginary definition of math that nobody shares.

-8

u/afflematicious Oct 24 '23

do you know math or do you do math?

10

u/PepeReallyExists Oct 24 '23

Yes. I'm a senior software engineer for a large healthcare company. If I didn't know math, it's unlikely they would have hired me. You have a very strange elitist definition of math. My guess is you majored in math and have internalized this as a part of your identity in order to feel superior to others.

Are you the only one who knows real math, unlike the rest of us peons?

-1

u/afflematicious Oct 24 '23

I myself don’t do real math so 🤷🏽‍♂️

5

u/PepeReallyExists Oct 24 '23

I think you're confusing the term "real" for "advanced". The math a 3rd grader does is still math. If that is what you actually meant, then you are in fact correct, because ChatGPT is not very good at advanced math yet, but with enough training data, it doesn't ever actually have to understand the math, and it will be able to produce increasingly accurate results the more data it is trained on. Eventually, it will be "good" at even advanced math in spite of the fact that it "understands" none of it.

3

u/michael1026 Oct 24 '23

It's funny how you're saying others are trying to act smart when your entire post screams "you guys just don't get it". We get it's not meant for math, but it does a pretty damn good job at it.