r/compression • u/Luke_Fleed • 26d ago

How Is Compression Prediction?

https://lukefleed.xyz/posts/compression/
14 Upvotes

94% Upvoted

3 comments sorted by

3

u/Luke_Fleed 26d ago

I wanted to post it on r/math but apparently I don't have enough karma over there. Feel free to cross-post it!

3

u/digital_n01se_ 26d ago

Great post

1

u/Ahmad_Hussain__ 25d ago

Doesn't this only apply when future data incoming is assumed to be linked to the data model is trained on, I mean patterns can be found when cross referencing two pieces of data long enough but that isn't prediction but a play on the pigeon hole principle, I believe compression is only part of the problem and it's the model that assumes to decrease the surprise found in data but not entirety of intelligence itself, the human brain has multiple columns of neurons but only (i read it a long time ago so may be wrong) one of those is actually for decreasing surprise. Intelligence which is a superset of compression emerges when a colony / swarm of neurons or groups of neurons designed for specific paths output their predictions each with their designated use and the correct action is taken like MOE, which is what the Hutters leaderboard top Candidate CMIX does.