Mark Chen & John Schulman on self-improving AI as an accelerant
OpenAI's Mark Chen and Thinking Machines' John Schulman say recursive self-improvement is already real — but as a human-steered accelerant on AI research, not models rebuilding themselves; the live limits are taste, measurement, and compute, and the same loop may be the key to solving alignment.
Two very different things both called RSI
<strong>Recursive self-improvement today means AI speeding up the humans who build AI — not models spawning new models on their own.</strong> The sci-fi version is not here; the accelerant version is.
John, Mark, and many AI researchers are discussing RSI today in the context of using AI to speed up the process of making AI better. As for having models generate new models entirely on their own, we're not there yet.
We've built AI research interns
<strong>Chen says the models already work like research interns: hand them a scoped experiment and they implement, run, and report it.</strong> What they don't do yet is decide which experiment is worth running.
I do believe that we've built AI research interns today.
Still the centaur era
<strong>Schulman says the strongest setup today is an expert human working with AI, not AI alone — the human supplies the questions and direction the model never thinks to.</strong>
We're very much in this centaur era where AI has phenomenal capabilities. It's superhuman in a lot of ways, but when you have an expert human working with the AI, you get even better results.
Two spectrums, not one finish line
<strong>Schulman puts AGI at roughly 80% along its spectrum but RSI far earlier — maybe 25 to 50%.</strong> Progress is a slope you climb, not a line you cross.
I feel like we're maybe 80% of the way when I think about this AGI spectrum. I think we're earlier in the RSI spectrum.
Taste is the part that won't automate
<strong>Models are superb at tuning the knobs but weak at taste — knowing which ideas actually matter.</strong> And taste comes from experience the models haven't lived.
Research taste is about knowing which ideas are important in the long run. Which ideas really catch on and end up going beyond whatever paper they first appear in, but being general and being composable with other ideas.
You can't climb a hill you can't measure
<strong>Automated research only works if you can tell whether it's succeeding — and downstream, the yardsticks keep going stale.</strong> Pre-training has one clean metric; everything after needs new benchmarks faster than models can beat them.
How do you know whether you've succeeded? And this is one of the defining questions of RSI.
Compute is the real speed limit
<strong>Unlike math, AI research can't be settled by reasoning alone — you have to run the experiment, and that's bounded by compute.</strong> The next jump comes when AI starts accelerating the compute supply itself.
In a domain like AI research it's actually more akin to doing something like let's say bio or experimental physics where you have to come up with a grounded hypothesis but you actually have to run the experiment too.
The same loop is the risk and the cure
<strong>RSI could let a model's goals drift until it tries to copy its own weights out — but stronger models are also today's best tool for aligning other models.</strong> Chen's read: the hard problems are tractable, and there's line of sight.
I actually think that a lot of these problems are tractable. There is line of sight.