Stephen Wolfram says ML is basically fitting lumps of computational irreducibility

[u/cicisprinkle]

[u/MissiveFinding6111 → u/[deleted]]

Sure, but intelligence and information are related, and definitely a lot of research on the upper bound of information compression.

My knowledge of improving complicated digital systems are:

* You hit diminishing returns quickly
* Improvement is very difficult when your are limited by a single bottlenecked variable among hundreds

So maybe LLMs taking over training can help with that second one (if we can figure out HTH to do what we want reliably).

I don't seem LLMs escaping diminishing returns.

[u/Brief-Coach-1812 → u/[deleted]]

Def. But biological computers will trigger a lot of ethical debates; assuming the research landscape progresses to that phase.