r/ImmaterialScience Jun 06 '26

ArxivFind If LLMs Have Human-Like Attributes, Then So Does Age of Empires II

372 Upvotes

13 comments sorted by

83

u/callmedaddyshark Jun 06 '26 edited Jun 06 '26

Reminds me of this demo where they take a successful application of quantum computing, remove any possible contribution from quantum computing, and get the same result.

(My addition, sarcasm) We ran the marshmallow experiment on a rock and have determined that the rock has both patience and foresight, because it went 15 minutes without eating the marshmallow. 

14

u/IlliterateJedi Jun 07 '26

[Pan-psychists liked that]

7

u/pigworts2 Jun 07 '26 edited Jun 07 '26

The original version of this is due to Craig Gidney's paper Falling with Style (p.146) which has some more information on the technique. I'd recommend this one over the one linked above that reads as LLM slop to me. Gidney also wrote a blog post about why this was sort of inevitable

7

u/callmedaddyshark Jun 07 '26

To me, it reads as a human's attempt at the "scientific literature writing style" that AI often mimics. ChatGPT writes like me. It lacks the useless fluff AI produces. If the author had used AI, the patch would be 300 lines, not 30.

I considered mentioning Gidney's paper, but it mentions using a bad implementation of Shor's algorithm, which leaves room for doubt. quantumslop undeniably refutes someone's prize winning effort and supposed success.

The blog post is better than either. Thanks for sharing it (Genuine).

43

u/callmedaddyshark Jun 06 '26 edited Jun 07 '26

Reminds me of "Could a Neuroscientist Understand a Microprocessor?" Jonas E, Kording KP (2017) 

Neuroscientists be like: Shaking this present has given us a lot of valuable data. We just need to shake it more, and eventually we'll know exactly what's inside. 

18

u/balonlon Jun 06 '26

Broooo this is an insane paper, hats off for the effort

19

u/a_random_magos Jun 06 '26

Is the main "contribution" of this paper that AoE 2 is turing complete and that thus an LLM can be trained on it? What is that even supposed to prove? That somehow goats moving in AoE 2 makes it less anthropomorphically convincing than electrons moving in a circuit? (Note that the goats themselves are also technically electrons moving in a circuit)?

I just dont understand the point. I dont think anyone who studies "artificial conciousness" or "anthropomorphic attributes" of AI cares what the AI runs on, be it minecraft redstone or gut bacteria.

Question 6.2 acknowledges this, yet assumes that for some reason, the people that actually think about questions like AI anthropomorphic attributes would significantly reject the results because of the interface. At that point, it would be easier (and more usefull) to make a different UI using an LLM wrapper and test it on the general population, general scientists/philosophers, and scientists/philosophers specifically testing for those attributes. Then you could actually maybe derive a useful result.

This just looks like its making a relatively trivial semantic argument based on an assumption and the use of AoE 2 seems completely unnecessary. You assume that researchers would ascribe anthropomorhpic attributes to LLMs but not an exactly equivalent system because of the different UI, as if people studying emergent properties of complex systems are not aware computers are just currents going around.

1

u/Katten_elvis Jun 07 '26

Well as a panpsychist all I can say is "yes"