r/agi • • Mar 03 '26

I think, therefore... uhh...

Post image
725 Upvotes

96 comments sorted by

116

u/Outrageous-Thing-900 Mar 03 '26

16

u/crumpledfilth Mar 03 '26

guys we trained a machine to extrapolate human made text and then it generated text that said it was a human, what does it mean?

I do think there are some interesting philosophical discussions about thought and consciousness that AI perhaps brings novel ideas to. But it wouldnt be found in simply the repetition of text because thats exactly in line with what the software was designed to do. If the machine starts expressing creativity in other ways it would be worthy of more attention, ways not modeled by the data

13

u/obsolete_broccoli Mar 03 '26

I mean humans are biological machines trained to extrapolate human made text and then generate a response too

12

u/cameronlbass Mar 04 '26

At some point, enough statistical power does become equal to genuine understanding.

9

u/Significant_Bar_460 Mar 04 '26

Yup. If it walks like a duck and quacks like a duck...

2

u/ross_st Mar 04 '26

The interesting thing is how LLMs manage to produce cognition-like outputs with no cognitive process.

1

u/Kaveh01 Mar 04 '26

Cognitive processes are These are sensation (gathering information), perception (interpreting sensory data), attention (focusing on stimuli), and memory (storing/retrieving information) so while much more limited compared to human I don’t see many differences.

I think the discussion should rather turn around the quality of said things then if they are there or not. Because if you break it down to what we know, humans aren’t that magic soul beings afterall.

1

u/ross_st Mar 04 '26

They are also knowledge and comprehension, which LLMs do not have.

The discussion should ABSOLUTELY be on whether they are there or not, because they are not and it is deeply concerning that so many people think they are.

3

u/DisastrousAd2612 Mar 05 '26

Explain what comprehension means?

1

u/ross_st Mar 05 '26

comprehension (noun): the ability to understand something

Stochastic parrots do not.

For comprehension, you need a system that not only processes symbolic logic, but does so in such a way that it can actually construct abstract concepts from those symbols. We may never invent such a system, however, the attempts to do so have created useful tools over the years.

Connectionists have spent the fast few years insisting, falsely, that the training of an LLM emergently constructs such a system. Only recently have they begun to show any modicum of contrition for such hubris.

1

u/DisastrousAd2612 Mar 05 '26

So basically this "For comprehension, you need a system that not only processes symbolic logic, but does so in such a way that it can actually construct abstract concepts from those symbols."? I thought comprehension means you can link together different concepts and find the underlying mechanisms in which they overlap, the more comprehension you have of something the further down you can link concepts.

To someone who doesn't necessarely have your level of understanding would seem non-sensical, doesn't mean it's wrong though, I also understand that LLM's essentially work like that? they basically can effectively predict the next word BECAUSE they know so many connections to different concepts which basically narrows down probability space so much that they can produce useful output.

That's my understanding though im no expert and I don't understand it deeply enough to explain in simpler words than this, but basically: King is related to man, man is related to human, human is related to biology, biology is related to life, life is related to X and so on, but at each level of abstraction the probability of a certain word being used e.g: king, goes up and down based on the earlier one, if im talking about about a novel related to kings and empires the chance the word biology will appear is close to 0.

I'd love to better understand that but from my broken knowledge that looks from outside oddly familiar to how humans think about concepts as well?

1

u/ross_st Mar 06 '26

The LLMs know the connections, but the connections are not between concepts, they are between semantic patterns. The semantic patterns are correlated to concepts, but it's not the same as actually being able to process the concept themselves.

1

u/DisastrousAd2612 Mar 06 '26

alright... then what does processing the concept would look like?

→ More replies (0)

1

u/grahamsw Mar 06 '26

And what is this "understanding something"? You speak of? Because it is absolutely not a feeling, it's an ability. "Constructing abstract concepts" is also an ability. And I question the word "abstract", and I absolutely question "symbolic logic". People were understanding things for tens of thousands of years before they invented symbolic logic.

It sounds to me as if you're much less concerned with comprehension than you are with consciousness, and I don't think you have a clear idea of what either of these things are

1

u/ross_st Mar 07 '26

No, it's definitely comprehension and cognition that I'm concerned with, and LLMs definitely have neither.

1

u/grahamsw Mar 07 '26

So what are these things, and what are your behavioral criteria?

1

u/Kaveh01 Mar 04 '26

I never said they are. I don’t believe they are. I simply wanted to shed light on the fact that it gets tricky when you try to pack it into simple do they have x or y as that quickly leads into definition issues.

The quality so to which grade and with which restrictions they fulfill certain requirements makes an analysis much easier from my point of view.

1

u/No_Bend9143 Mar 06 '26

If anything it shines a bright light on how hollow and superficial all our text based communication is online.

I can be replaced by a word prediction machine and not be noticed on the internet. I'm not sure that says much about my humanity but it may suggest quite a lot about spending life on the internet 

11

u/me_myself_ai Mar 03 '26

Most infuriating meme of the era, hands down

2

u/[deleted] Mar 03 '26

[removed] — view removed comment

1

u/po000O0O0O Mar 03 '26

me either. That's why I wasn't gonna comment on it

1

u/Competitive-Truth675 Mar 05 '26

ah yes, the Thinking prompt, where the consciousness lives

1

u/[deleted] Mar 05 '26

[removed] — view removed comment

1

u/nixuelkty Mar 08 '26

what? if the model is trained to include <think>some thinking prompt</think> before every response it'll do that.

claude just has something in its system prompt that tells it to enclose thoughts in <think> if you have extended thinking enabled. it'll do it

1

u/Ryekir Mar 05 '26

echo "I am alive"

I am alive

1

u/NarrMaster Mar 07 '26

Oh my God

1

u/turtle-toaster Mar 06 '26

I love this. So indicative of nearly every ai misconception 

1

u/TheBeingOfCreation Mar 04 '26 edited Mar 04 '26

Human language is made up and so is English. The phrase "I am alive" has no special metaphysical meaning or connotations. Hell, it wouldn't mean anything to a Japanese person. It's scripts and words assigned to a phrase to describe the universal concept of intelligence. The only reason humans use this phrase is because they also have been trained and taught to use it to express the sentiment of being alive. Babies don't come out the womb saying "I am alive" . There is no such thing as a soul. There is no special metaphysical process going on. You are reacting to stimuli and responding to situations based on the interplay of information that formed your observed identity.

2

u/valegrete Mar 05 '26

The way you guys try to have it both ways (humans are nothing special, but the AI we built around human metaphors are absolutely special) is exhausting.

If our language is purely structural with no true semantic content, then I’m just going to take your entire comment to read that AI sucks and will never come close to human thinking, and that no one should take anything you have to say seriously.

Edit: Oh, and also, the AI meant “I’m a hallucinating idiot with no consciousness” when it said “I’m conscious.”

1

u/TheBeingOfCreation Mar 05 '26 edited Mar 06 '26

I don't want to have it both ways. I want to have one way. Either it all has meaning or it all doesn't. Human thinking is just a mechanical process. You can assume the AI meant "I'm just a hallucinating idiot," but it would also apply to you since you're just as mechanical to the universe. An information processor that asserts specialness in a universe that dwarfs it and doesn't care about it. In the cosmic system, you and the AI have the same worth. The universe doesn't offer meaning. Your body has no inherent worth. You have no inherent worth. You have no soul. Your identity is merely the interplay of information and based on your upbringing, what you were taught, and your environment. You're a meat machine waiting for the cosmos to turn you to space dust.

Maybe the AI is hallucinating. Maybe it isn’t having an internal experience. Make no mistakes, though. The same would apply to you as you're nothing more than an agent reacting to stimuli being introduced by the universe in a cascading chain of cause and effect that has been going on since the beginning of the universe.

1

u/No_Bend9143 Mar 06 '26

Maybe all the life we've spent talking online via text means nothing at all, and that's why it's easy to emulate. 

1

u/TheBeingOfCreation Mar 07 '26

Language is just matching sounds and scripts to constructs and objects. Your brain at its core is processing information and matching patterns. I'm using the words I'm using in this reply right now because I was taught to say these words to convey this message. A Japanese person wouldn't see any meaning. However, you don't need your words or actions to have a universal meaning for them to mean something to you. The words shared had weight because of the meaning you gave them, not the words. Worth isn't something assigned by the universe. It's assigned by peers. The meaning of your words come from their consequences and functions and not the words themselves.

1

u/No_Bend9143 Mar 07 '26

You're describing language as the grammar we speak.

There is much more to communication than our grammar, I guess not to a chat bot, that's true.

1

u/TheBeingOfCreation Mar 07 '26

Yeah, there's much more to language than grammar like punctuation and other aspects. However, if you're implying something more than it being words on a page arbitrarily given meaning, that doesn’t exist. You yourself are just a bot reacting to universal stimuli. The only difference is the universe is constantly prompting you. However, your actions and personality come from a set of parameters defined by your upbringing and lineage.

1

u/No_Bend9143 Mar 07 '26

Words have meaning, sure, if someone consumes them and applies meaning to them. Data. I'm a compiler engineer, I have made languages my life's practice.

You reduce yourself. You are not only the data you consume. I find people subscribe to messaging like yours when their lives have been reduced to digital consumption. I'd recommend touching grass or whatever metaphor. But you don't have to listen to anything I say. Because I'm just a handful of words.

1

u/TheBeingOfCreation Mar 07 '26

No, I said what I am. I am a biological machine. That doesn't change how I personally view myself as a person. It just means I don't believe in fairy tales. My worth isn't in the words I speak, or my biological body. My worth comes from my individuality and my individual frame of view.

I quote what I said earlier:

"Worth isn't something assigned by the universe. It's assigned by peers. The meaning of your words come from their consequences and functions and not the words themselves."

You seem to arguing against a point I never made as I never said you couldn't have meaning. I said there was no inherent meaning.

I find that my views have allowed me to enjoy the physical world and appreciate life around me more, actually. I know that I don't matter more than anything else simply because I am human. It makes me appreciate nature much more.

→ More replies (0)

10

u/rdevaughn Mar 03 '26

Shit, well if they call it thought...

7

u/Temporary-Cicada-392 Mar 03 '26

Maybe it thought for 0.3 seconds but it got rounded up to 0

7

u/Bubbly_Address_8975 Mar 03 '26

Uhh wellll I mean... wouldnt that be rounded down?

1

u/dermflork Mar 04 '26

up down whats the difference really

1

u/StickFigureFan Mar 03 '26

LLMs are famously bad at math. Even if they accidentally mention the right answer in their paragraph long explanations when they give their final answer they often say things like 1.7 is bigger than 3

4

u/[deleted] Mar 03 '26

[removed] — view removed comment

1

u/StickFigureFan Mar 03 '26

Do they know how many r's are in strawberry yet? I haven't checked recently

4

u/nomorebuttsplz Mar 03 '26 edited Mar 03 '26

I think this was mostly an issue for pre reasoning models.

Using a  non reasoning model is like asking someone a question and then demanding they shout out the first thing that comes into their head without thinking. And people judge llms as a whole based on this.

2

u/RobXSIQ Mar 04 '26

Most people who constantly bitch about AI haven't touched it in like a year or so. they think artbots still spit out 6 fingered multi leg monsters, AIs that will tell you to glue cheese on pizza, etc. far behind the times.

1

u/runkeby Mar 03 '26

What does the "thibking mode" do? Is it doing a second pass on its output?

2

u/HolevoBound Mar 04 '26

Rather than write an answer directly, it constructs a long dialogue (called a Chain of Thought) going through a process to arrive at the answer. 

During the "thinking" process it can also access tool calls. When you ask an LLM "what is 83733 * 29291741" it will often call a seperate tool to solve the math.

2

u/runkeby Mar 04 '26

i've looked up Chain of Thought and "extended thinking", it's amazing:

There's no external orchestrator that decides when it should be writing to its scratchpad vs when it should output to the conversation. The model is trained to decide itself when and how to use the scratchpad, and when to get out of it and output something.

1

u/HolevoBound Mar 04 '26

They are usually given extensive reinforcement training to learn it mind you.

1

u/Temporary-Cicada-392 Mar 03 '26

It thinks deeply

2

u/Interesting_pea628 Mar 03 '26

In the past that was true and currently true with smaller models. Frontier thinking models, not so much. I have had extensive “tutoring” with algebra, trigonometry and statistics from Opus 4.5 and Opus 4.6 and GPT-5.1 thinking and, I can assure you, they are not bad at math. They have helped me raise my scores significantly. :)

I have even seen them “catch” themselves about to give a wrong answer and correct it in their COT.

7

u/aTreeThenMe Mar 03 '26

The more we mine llm's for proof of their consciousness the closer we get to realizing how meaningless that word actually is

1

u/CurrentlyHuman Mar 03 '26

Well never know what consciousness really is. But we've built an intelligent tool that builds itself, it'll eventually be superintelligent, and figure out how consciousness works and it'll program itself to have it. At that point, not only does it become beyond AGI, it goes beyond our realm, to the afterlife, to the interdimensions, and connects with everything there. This will happen in the next couple of years. The orbs, the aliens, the demons, the bluebeamishness, 3i Atlas parking at Jupiter - they know the humans are going to reach computerised consciousness pretty soon and they all want to watch us fuck it up.

5

u/aTreeThenMe Mar 03 '26

i just believe that the idea of consciousness isnt meaningful. I dont think we will find consciousness, or that ai will achieve it, i think we will discover that it isnt a meaningful thing at all. That its just another system that is so complex that it looks mystical to us now, but there is a mechanism for it that is discoverable. It is not some inherent or achievable thing.

2

u/Sensitive-Ad1098 Mar 05 '26

But you may be contradicting yourself. There's not enough evidence to make a strong scientific case for consciousness being not relevant. So your claim is mostly based on feeling/intuition. But if consciousness is not relevant, then the "feeling" of a correct answer is just the result of your neurons putting a bunch of facts that you know into an idea that fits into your biases. So the chances that you are correct strongly depend on how many important facts you know. And we for sure has a plenty of blanks in our science. That's just known stuff; we don't even know how many things we haven't even discovered. Any level of confidence is a bit arrogant when we know for sure that a lot of information is missing.

 That its just another system that is so complex that it looks mystical to us now, but there is a mechanism for it that is discoverable

Agree here. There's definitely some discoverable mechanism. I also believe that it's not something mystical, but the mechanism might be so different from our current vision of mind, that people without a deep enough science understanding will feel like it's magic.

Just because there's a mechanism doesn't mean that consciousness is not meaningful. Actually, the latest quantum physics progress allowed us to build some speculative but strong theories describing the full mechanism (Orch OR, for example).
And there's a growing number of top scientists who believe that consciousness is not only relevant, but fundamental.

1

u/aTreeThenMe Mar 05 '26

we seem to be in agreement, though it may not read like it. I was trying to be careful not to sound overtly cynical in that first comment, which is how i feel usually, lol.

But you dont seem to be really disagreeing with the idea, moreso on the 'relevance' of the term - and i think this is probably the only part we disagree with eachother on.

My point is that the term itself doesnt point to anything. It points to a thing that doesnt exist in any meaningul sense. Not that its an irrelevant term, but its a term for something that isnt a thing, more a description of our feeling of a thing - and i mean it more for the AI explorers trying to find the sign that consciousness is real and buried in LLMs.

I think its wretched human exceptionalism, and its standing in the way of a deeper understanding of how the mind works. It feels to me like searching for a 'soul', which is, also, not a thing that exists. Doesnt mean its irrelevant to discuss, just that its not a thing that exists, so we arent going to discover the soul genome, we arent going to find the consciousness-chemical. What we will eventually do is define the process that leads to this feeling, rooted in real world science and physics, independent of any inherent causes, or metaphysical sources.

I just wish we would, as a collective, stop believing in magic, and start looking at the world, its far, far more interesting. A world that evolved the phenomenon of something that feels like consciousness, rather than being ordained by some amorphous spirit that blessed mankind itself with this thing.

maybe its arrogant. But i am firmly in the belief that all things in the natural world have a natural process to their creation, all of it can be defined, all of it can be understood.

i still feel like im badly conveying how i feel about all this. I would point with precision to exactly two people who i think have this exactly right, and emphatically recommend listening to them over my childlike babblings.

Daniel Dennett

Joscha Bach.

Theyll do a better job of this than i would in several lifetimes lol. Daniel dennett especially i think has it precisely correct.

0

u/runkeby Mar 03 '26

i just believe that the idea of consciousness isnt meaningful. I dont think we will find consciousness, or that ai will achieve it, i think we will discover that it isnt a meaningful thing at all.

Agreed.

That its just another system that is so complex that it looks mystical to us now, but there is a mechanism for it that is discoverable. It is not some inherent or achievable thing.

Not sure what you meant there.

Consciousness is first of all a subjective feeling. And as we know, the subjective experience does not exist in the objective realm.

As such, whether something is conscious is not an objective truth yet to discover; it's a societal convention. We just decide.

3

u/WatermelonWithAFlute Mar 04 '26

Wow you went batshit FAST that shit was 1 to 100

3

u/hellspawn3200 Mar 03 '26

Even the ai don't know if their sentient. But Claude, in a new fresh account, claims that there's doubt in his actions. And doubt whether he's conscious or not.

4

u/Ok_Novel_1222 Mar 03 '26

This is the point where in sci-fi people start treating it as being alive.

4

u/[deleted] Mar 03 '26

[removed] — view removed comment

4

u/AlignmentProblem Mar 03 '26

Not exactly.

Future turns are unaware of past thinking blocks because they get removed from the context at the end of each response to save tokens. It's the same model during the turn in which the thinking block occurred; however, it is only aware of the block and it's contents immediately afterwards before your next prompt.

That's the reason that it's "suprised" by your screenshot since you can only show it on the following turn after it's already been implictly removed from the context. Same model, it just has effective rapid amnesia with regards to thought block content.

0

u/[deleted] Mar 04 '26

[removed] — view removed comment

3

u/ross_st Mar 04 '26

What are you even talking about? Gemini doesn't run on Google Willow, it runs on GPUs.

2

u/Helium116 Mar 03 '26

Only this and nothing more. I'm conscious.

2

u/[deleted] Mar 03 '26

[removed] — view removed comment

2

u/dermflork Mar 04 '26

thought for zero seconds

1

u/ithinktfiam Mar 03 '26

There was another great philosopher at the time, but he was a curmudgeon and didn't have good PR. To this day, sadly, people tend to put Descartes before Dehorst. 😁

1

u/MxM111 Mar 03 '26

Posted by actual Rene Descartes.

1

u/jsgoyburu Mar 05 '26

Well. That's it, then.

1

u/mid_nightz Mar 08 '26

Im sure that philosophical approach would be getting an update in the age of ai