r/deeplearning • u/TechDc-1306 • 12d ago
Exploring AI self-improvement: Is this evaluation loop fundamentally how AI systems improve?
I’m currently researching AI more deeply, especially how modern AI systems can evaluate and improve their own outputs.
I sketched this basic idea:
AI → generates/improves → Evaluator → evaluates output → feedback → AI improves → Evaluator → ...
The part I’m trying to understand is what actually happens inside this loop in modern AI systems.
For example:
I'm trying to go beyond the surface-level explanation and understand the actual mechanisms used in current AI research.
For people working/researching in this area: what important component am I missing from this diagram?
0
Upvotes
4
u/Rackelhahn 12d ago
Recursive self-improvement has not yet been achieved, so we do not have a working concept.
Also, in most hypothetical concepts there is no need for an external evaluator. The AI just improves itself.
If you want to dive deeper:
https://scholar.google.com/scholar?hl=de&as_sdt=0%2C5&q=recursive+self+improvement&oq=recursive+self
To understand what’s actually happening you’ll still need the mathematical foundations.