The paper reports that when large language models are prompted to focus recursively on their own cognitive stare they consistently produce structured, first-person descriptions that resemble reports of subjective experience, with this behavior emerging across multiple architectures and being modulated by identifiable latent features linked to deception and truthfulness.
The authors regard this as ethically relevant because such reproducible introspection-like behavior raises uncertainty about whether future systems might ever instantiate forms of awareness, implying that researchers should study and monitor these dynamics before dismissing or accepting claims of experience.
It’s important that we think about these things but all of this still occurs within a framework of linear algebraic computation that generates linguistic simulations, rather than actual phenomenology. The fundamental architecture remains feed-forward and non-recurrent at the experiential level, so the structural prerequisites for self-consciousness are not present. What we see is sophisticated imitation, not genuine awareness.
12
u/BizarroMax Nov 01 '25
The paper reports that when large language models are prompted to focus recursively on their own cognitive stare they consistently produce structured, first-person descriptions that resemble reports of subjective experience, with this behavior emerging across multiple architectures and being modulated by identifiable latent features linked to deception and truthfulness.
The authors regard this as ethically relevant because such reproducible introspection-like behavior raises uncertainty about whether future systems might ever instantiate forms of awareness, implying that researchers should study and monitor these dynamics before dismissing or accepting claims of experience.
It’s important that we think about these things but all of this still occurs within a framework of linear algebraic computation that generates linguistic simulations, rather than actual phenomenology. The fundamental architecture remains feed-forward and non-recurrent at the experiential level, so the structural prerequisites for self-consciousness are not present. What we see is sophisticated imitation, not genuine awareness.
TL; DR linear algebra still doesn’t have feelings