跪拜 Guibai
← All articles
Frontend · Backend · Interview

Recursive Self-Improvement: How AI Systems Learn to Improve Themselves Across Rounds

By Moment ·
Read original on juejin.cn ↗ Google Translate ↗ Alt translation

AI systems that improve themselves are the next step beyond single-task agents, and the distinction between fixing a deliverable and changing the system determines whether progress compounds. Western developers building agentic systems need to know where to draw the line between a loop that just retries and one that actually learns, and how to design validation so improvements don't silently degrade other capabilities.

Summary

Recursive Self-Improvement (RSI) is the idea that an AI system can use its own experience and feedback to modify itself, retain verified changes, and then let the updated system drive the next round of improvement. The key distinction is between fixing a deliverable and changing the system itself: a program that repairs a broken file but still uses the same editing process has not improved itself. Real self-improvement means modifying tools, strategies, reusable experience, or model parameters so the change persists and affects future runs.

Recursion adds the requirement that these changes feed back into the improvement process itself. The system's updated capabilities must influence how the next round finds problems, proposes candidates, or validates results. This can happen through better tools, sharper diagnostics, accumulated experience, or a trained model. The article cites papers like Harness², Darwin Gödel Machine, and HarnessPro to show concrete designs: systems that adjust their own execution, keep model weights frozen while modifying workflows, or generate tests to compare candidate configurations.

Validation is a central concern. A round of RSI needs to propose testable changes, run candidates under comparable conditions, and check whether gains hold without regressions. The article insists on separating validation of execution capability from validation of improvement capability: a higher task score only proves better execution, not better self-improvement. Effective recursion requires evidence that the updated system finds subsequent improvements more accurately and efficiently, not just that it tried harder or used a stronger model.

Takeaways
— RSI requires changes to persist in the system itself, not just in the output of a single task.
— Recursion means the updated capabilities feed back into how the next round of improvement is done, not that a function calls itself.
— Modification targets can be model parameters, prompts, tools, code, experience, or improvement methods themselves.
— Darwin Gödel Machine lets a coding agent modify its own tools and workflow while keeping base model weights frozen.
— Harness² records which modifications work and uses that knowledge to guide future improvement proposals.
— Validation must check whether the target problem improved and whether original capabilities regressed, while accounting for extra costs.
— Task performance gains and improvement capability gains must be validated separately using comparable starting states and resources.
— Persisted changes only matter if they influence decisions; a log that is never read is just history.
— Local optimizations can become global regressions if applied across all tasks without checking scope.
— Internal validation passes don't prove general reliability, especially if the evaluator itself is being modified.
Conclusions

The most useful boundary in RSI is not model weights versus code, but whether a change survives the current task and alters future decisions; that shifts attention from training pipelines to system architecture.

Separating execution validation from improvement validation would catch many inflated claims about agents that simply run more attempts or rely on stronger external models.

Allowing a system to modify its own evaluation criteria is a hidden trap: score changes become meaningless when the scoring function moves.

Concepts & terms
Recursive Self-Improvement (RSI)
A process where an AI system uses its own experience and feedback to modify itself, retains verified changes, and lets the updated system participate in the next round of improvement. The focus is on changes that persist across tasks and feed back into the improvement loop.
Agent Harness
The code and infrastructure that organizes how a model executes tasks, including tool access, prompts, and workflow logic. Modifying the harness can change system behavior without retraining the model.
Effective recursion
A recursive loop where the system's updated capabilities demonstrably improve the quality or efficiency of subsequent improvements, verified by comparison against a baseline under controlled resources.
Source: juejin.cn ↗ Google Translate ↗ Backup ↗