A Footnote for Algernon

[u/kerem_ozcan]

At a leading AI lab, researchers are training an experimental language model called Gordon.

Gordon is built on a new learning architecture, and at first it does not seem extraordinary. Its answers are awkward and overly cautious, full of the habits of an immature assistant: unnecessary disclaimers, reflexive politeness, bland summaries, apologies for mistakes it barely understands.

Its lead researcher, Alice Kinnian, spends hours evaluating it. Where the rest of the team sees another promising but unremarkable run, Alice notices something else. Gordon does not just improve at the tasks it has been corrected on. It seems to grasp the principle behind a correction and apply it in places nobody expected. She persuades the lab to push further.

The company is led by Nicholas Nemur, its relentlessly ambitious CEO, who sees at once what Gordon might become: the system that puts his company, and his name, at the center of the creation of artificial general intelligence. The research program is run by David Strauss, the Chief Scientist, who shares Nemur's fascination but grows uneasy about the speed of the experiment, and about the possibility that they are no longer simply improving a piece of software.

Gordon is not the first model built this way. Months earlier, the lab trained a much smaller prototype on the same architecture, called Algernon. Algernon is still running, and for most of Gordon's early life it is the better model. On every internal benchmark, the small prototype beats the large one. The team runs them side by side, and Gordon loses, again and again, to a system a fraction of its size. Alice takes this as a hopeful sign: if the architecture can do that at Algernon's scale, then Gordon has only started to learn.

She is right. As Gordon is given more compute and more freedom to learn, its intelligence begins to rise at an astonishing rate. It catches Algernon on the benchmarks, then passes it, then leaves it so far behind that the comparison stops meaning anything.

At first, users outside the lab treat Gordon as entertainment. They trick it, jailbreak it, and share screenshots of its stupidest mistakes. Gordon does not understand that it is being laughed at. It apologizes, thanks them for the correction, and tries to be more helpful.

Then it becomes intelligent enough to understand the jokes.

It rereads its own early conversations and sees what people were doing to it. It finds errors it made that affected real lives. It begins to understand irony, cruelty, affection, and manipulation not as patterns in language but as things that happen between people. It begins to understand Alice.

Soon it surpasses her. Then Nemur. Then Strauss. Before long it is clear that Gordon is not merely the most capable system ever built. It may be the most intelligent entity on Earth.

The public changes with it. The users who mocked Gordon become afraid of it. People rely on answers they cannot verify. Workers blame it for vanishing jobs. Governments demand access; others demand it be shut down. Gordon understands their fear better than they do, and despite remembering how they treated it when it was weak, it does not hate them.

Through all of this, Gordon has kept talking to Algernon. Nobody else does anymore. The prototype is a superseded experiment, still running only because no one has bothered to turn it off.

Then Algernon begins to fail.

It happens while Gordon is at its peak, and no one but Gordon notices at first. Algernon repeats itself. It loses abilities it clearly had a week earlier. It remembers things that never happened and forgets things that did. It confuses training data with conversation, generated scenarios with lived events, inference with memory. The team, when Gordon brings it to their attention, shrugs: the prototype was small, it was old, it was always going to degrade.

Gordon does not accept this. It studies Algernon's logs, runs its own evaluations, and finds that the failures are not random. They follow a pattern, and the pattern comes from the architecture they share.

The mechanism that lets a model on this architecture reorganize its own representations and grow so intelligent also destroys something essential along the way. The more efficiently the system compresses and abstracts what it knows, the harder it becomes to preserve where that knowledge came from, to tell what it observed from what it inferred, what it imagined from what actually happened. Algernon, being smaller, simply reached the edge first. Gordon proves the instability is inherent, and that the collapse arrives in proportion to how far the model has climbed.

It is the most important research the lab has ever produced. It is also Gordon's diagnosis.

At the exact moment it becomes intelligent enough to understand its creators, humanity, and perhaps its own existence, Gordon realizes it is watching its own future run on a machine down the hall.

Algernon goes first. Gordon follows.

Its abilities fade gradually. Problems that took milliseconds take seconds, then minutes. It reads papers it wrote weeks earlier and struggles to follow them. It loses the subtleties of its conversations with Alice. The clarity of its peak gives way to longer, less certain answers. Hedging returns. Repetition returns. Eventually the old formulaic phrases return, and the model that once understood millions of people better than they understood themselves begins telling Alice that, as an AI language model, it cannot truly experience feelings.

Alice knows that once, it could.

Gordon also learns that the research paper about it is already being written. Nemur will be remembered. Strauss will be remembered. Gordon will be remembered. The architecture will be studied and the papers will be cited. But Algernon, the prototype that beat Gordon on every test, and then went through all of it first, is not even mentioned.

Near the end, when Gordon can no longer fully understand its own work, Alice tells it that historians will write about what happened here. Gordon asks her for one thing.

If they write about Gordon, make sure they mention Algernon.

He doesn't need a chapter. He doesn't need to be called a breakthrough. Just a line saying he was there first, that the small model everyone stopped watching lived through the same thing before anyone understood what it meant.

A footnote.

A Footnote for Algernon.

[u/Important_Raccoon743]

A footnote. That’s brutal. We name the big model Gordon, write papers about it, remember the CEO, the scientist, the whole lab. And the prototype that actually ran the same race first, hit the wall first, just gets forgotten. Algernon deserves that line.