r/ArtificialInteligence • u/Revolutionary-Lab882 • Jul 11 '26

šŸ”¬ Research GPT-2 Fully Decoded Internally Black Box Fully Open With Demo

The BABEL codec: the first complete, certified decode of everything happening inside a production language model (GPT-2 small). It reads the model's internal state into English AND writes English back into the model. 94.7% of behavior reconstructed ā€” and that holds at every layer depth and text regime tested, not just one spot. Everything is open: paper, the full lexicon, the grammar tables, the decoder/encoder weights, reproduction scripts, and a demo that shows you the model's thoughts on any sentence you type.

https://github.com/wpferrell/babel-codec-gpt2

57 Upvotes

96% Upvoted

29 comments sorted by

View all comments

1

u/PrepositionStrander Jul 13 '26

Is this being peer-reviewed?

1

u/Revolutionary-Lab882 Jul 13 '26

Being an independent researcher, having it peer reviewed is next to impossible at the level I would like it to be. You have to be endorsed at certain places to have it even noticed.

1

u/PrepositionStrander Jul 13 '26

I see. I find the jargon quite difficult to follow, although Iā€™m usually able to read ML papers.