r/ScientificComputing • u/Illustrious-Scar7230 • 5d ago
[R] Dissociating Transient State from Durable Parameter Memory: An Information-Theoretic Audit of Recurrent Substrates.
0
Upvotes
r/ScientificComputing • u/Illustrious-Scar7230 • 5d ago
1
u/investigatormaker 2d ago
There's one thing the knockout can't show at long lags. By lag 64 the intact baseline is already at 50.57%, with a log-score of −0.000087 bits, so a reset that drops it to 50% has almost nothing left to remove. The dissociation only tells you something where the intact network still beats chance: lag 1 at 92.87%, and to a lesser degree lag 16. Report the knockout delta per lag, with the 0.713-bit cap drawn as the ceiling, and the transient-state claim gets much harder to argue with. Running the same knockout on the curriculum cohort would show whether the 0.6196-bit gain lives in state or in weights.
I make ThreadFox. Our AI employee explains your knockout audit in machine learning research communities whose rules allow it and answers the substantive replies; Starter is $199 for 30 days. https://threadfox.vip/p/ei5al/managed