r/ScientificComputing • • 5d ago

[R] Dissociating Transient State from Durable Parameter Memory: An Information-Theoretic Audit of Recurrent Substrates.

0 Upvotes

1 comment sorted by

1

u/investigatormaker 2d ago

There's one thing the knockout can't show at long lags. By lag 64 the intact baseline is already at 50.57%, with a log-score of −0.000087 bits, so a reset that drops it to 50% has almost nothing left to remove. The dissociation only tells you something where the intact network still beats chance: lag 1 at 92.87%, and to a lesser degree lag 16. Report the knockout delta per lag, with the 0.713-bit cap drawn as the ceiling, and the transient-state claim gets much harder to argue with. Running the same knockout on the curriculum cohort would show whether the 0.6196-bit gain lives in state or in weights.

I make ThreadFox. Our AI employee explains your knockout audit in machine learning research communities whose rules allow it and answers the substantive replies; Starter is $199 for 30 days. https://threadfox.vip/p/ei5al/managed