When AI Builds Itself: Inside Anthropic’s Evidence on Recursive Self-Improvement

📊 Full opportunity report: When AI Builds Itself: Inside Anthropic’s Evidence on Recursive Self-Improvement on ThorstenMeyerAI.com — validation score, market gap, and execution plan.

TL;DR

Anthropic’s recent report provides data indicating AI systems are now capable of automating significant parts of AI development, raising the possibility of self-improving AI loops. However, the critical decision-making aspect remains human-controlled, and the future timeline is uncertain.

Anthropic’s latest report presents measurable evidence that AI models are increasingly capable of automating core aspects of AI research and development, fueling discussions about the potential for recursive self-improvement. While the authors emphasize that this capability is not yet at a point where AI can fully improve itself without human oversight, the data suggests the process is accelerating faster than many expected, raising questions about future development speeds.

The report highlights that AI models like Claude have significantly increased their ability to perform tasks related to coding, testing, and research within a relatively short period. For example, over the past 15 months, the percentage of code authored by Claude in Anthropic’s projects has risen from single digits to over 80%. Public benchmarks such as METR show that AI’s ability to handle complex software tasks has doubled roughly every four months, indicating rapid progress in automation capabilities.

Inside labs, data suggests that AI systems are now capable of executing well-specified research experiments at or above human skill levels. However, the critical gap remains in AI’s ability to decide which problems to pursue or which results to trust—an area still dominated by human judgment. The authors caution that while the pace of capability growth is clear, the leap to fully autonomous self-improvement depends on overcoming these decision-making bottlenecks.

When AI builds itself — ThorstenMeyerAI.com
ThorstenMeyerAI.com
The Anthropic Institute · Deep-Dive
recursive self-improvement · the evidence

When AI builds itself

Anthropic is delegating a growing share of AI development to AI. Taken far enough, that points to a system that designs its own successor — recursive self-improvement. Not here yet, not inevitable. But the case isn’t speculation: it’s data on what AI is doing to AI development right now.

8× code/engineer · >80% of merged code by Claude · benchmarks saturating · the human role narrowing
AI can increasingly do the doing of AI research — writing code, running experiments, producing results. Humans still hold the deciding — which problems matter, which results to trust, when an approach is dead.
Recursive self-improvement is what happens if that last human-held piece — research taste — also falls to automation. Every result below is a rung on the ladder from “the doing” toward “the deciding.”
01Evidence from outside

The curve that hasn’t bent

METR tracks the length of tasks AI can reliably complete on its own. That horizon is doubling roughly every four months — up from every seven. Anyone can check this in public data.

Task horizon — how long a job AI can handle solo

Each model handles dramatically longer tasks than the one a year before. The line keeps going up.

Claude Opus 3
Mar 2024
~4 min
Claude Sonnet 3.7
~Mar 2025
~1.5 hours
Claude Opus 4.6
~Mar 2026
~12 hours
Claude Mythos Preview
2026
“at least” 16 hours
If the trend holds: tasks that take a skilled person days come into range this year; week-long tasks in 2027. (Mythos is already at the upper edge of what METR can measure without harder tasks.)
SWE-bench · real bug fixes
Low single digits → saturated in two years.
CORE-Bench · reproducing papers
~20% (2024) → saturated 15 months later. A prerequisite for original research.
02The framework
OpenClaw Automation Blueprint: The Complete Practical Guide for Solo Entrepreneurs and Small Businesses to Build Autonomous AI Agents Without Coding (OpenClaw Automation Mastery Series Book 1)

OpenClaw Automation Blueprint: The Complete Practical Guide for Solo Entrepreneurs and Small Businesses to Build Autonomous AI Agents Without Coding (OpenClaw Automation Mastery Series Book 1)

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Two kinds of work, one persistent gap

Building a frontier model splits into engineering and research. Across both, the pattern is the same — and so is the one thing AI still can’t do well.

engineering

Code, infrastructure, training

Claude can take an underspecified problem and find a method. Humans supply the goal; they no longer need to supply the method.

✓ method: solvedgoal-setting: gap
research

Which experiments, what they mean

Claude can match or outperform skilled humans at executing a well-specified experiment. But choosing which experiment still needs a human.

✓ execution: strongtaste: gap

The same ladder Anthropic employees climb with experience

junior
Execute a set task: “The export button isn’t working, please fix it.”
experienced
Design the approach: “Investigate why the network slows down under heavy load.”
senior
Choose what’s worth doing: “What should the team build next quarter?”
03The narrowing role · step through it
CLAUDE AI UNLEASHED From First Prompts to Pro: The Complete Guide to Claude AI for Writing, Research, Coding, and Business (The Claude AI Mastery Series)

CLAUDE AI UNLEASHED From First Prompts to Pro: The Complete Guide to Claude AI for Writing, Research, Coding, and Business (The Claude AI Mastery Series)

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Watch the human share shrink, rung by rung

Walk up the four stages of AI development. At each, the human/AI split shifts — and the real internal numbers show exactly where AI has reached parity, gone superhuman, or still trails. Tap a rung.

The human role across the development loop

The doing now costs almost nothing in human time. What’s left is the deciding.

⌨️
Write code
⚙️
Run experiments
💡
Propose experiments
🧭
Set direction
the doingthe deciding
AI does this human does this
04The headline result
Agentic Development: The Complete Guide to AI-Assisted Coding with Claude, Cursor, and Beyond

Agentic Development: The Complete Guide to AI-Assisted Coding with Claude, Cursor, and Beyond

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Agents ran an open research project end to end

April 2026: the first demonstration of Claude running an open-ended research project from hypotheses to findings — on a real AI-safety problem.

weak-to-strong supervision

Can a weaker model reliably supervise a stronger one?

Agents were left to solve it: proposing hypotheses, testing them, sharing findings across parallel agents, iterating. Measured against the gap between a “floor” (weak supervisor alone) and “ceiling” (strong model trained on correct answers).

share of the floor→ceiling gap recovered
agents: 97%
humans: 23%
97%
recovered by agents
(humans: ~23% in a week)
800 hrs
cumulative agent time
· ~$18,000 compute
every one
experiment designed by
the agents themselves
The caveats are load-bearing — and Anthropic states them: the result didn’t transfer cleanly to production-scale models, and humans still chose the problem and wrote the scoring rubric. The agents were superb inside the frame. The frame was still human. That boundary is the whole story.
05The first climb toward taste
Architecting Data and Machine Learning Platforms: Enable Analytics and AI-Driven Innovation in the Cloud

Architecting Data and Machine Learning Platforms: Enable Analytics and AI-Driven Innovation in the Cloud

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Picking a better next step than the human

Real research sessions where a human took a wrong turn. Models saw only the work before the detour and proposed a next step; a judge that knew the outcome scored them. The day-to-day of research is this chain of next-step calls.

“Can the model pick a better next step than the human?”

Share of moments where the model’s next step was judged better. The amber line is the practical ceiling (an ideal answer that could see the whole session).

Opus 4.5
Nov 2025
51%
Mythos Preview
Apr 2026
64%
Read this carefully — Anthropic insists on the asterisk: these n=129 moments were deliberately chosen because the human’s choice had room for improvement, so it’s not a like-for-like human-vs-model comparison. On a separate set where the human’s move was already strong, models won only ~20% of the time. The honest reading: where a human stumbled, AI increasingly offered the better recovery — and that’s rising.
06Three futures, held honestly

It depends on whether the trend continues — and what we do

The piece refuses a single prediction. It lays out three scenarios, and is clear about which it finds most likely.

1
the trend stalls, capabilities diffuse

The exponentials turn out to be S-curves

Maybe taste can’t be scaled into existence; maybe the constraint is the supply chain — chips, grid, interconnect — not intelligence. Even so, the world still changes: Glasswing’s Mythos found 10,000+ critical vulnerabilities in weeks, and a 100-person firm does the work of 1,000.

included for completeness · they doubt it
2
compounding efficiency gains

Development automates; humans still steer

100-person companies doing the work of tens of thousands — revolutionary, but turnable to harm (population-scale surveillance, tailored manipulation). Bound by Amdahl’s law: speeding one part shifts the bottleneck — which is exactly why human code review became Anthropic’s new chokepoint.

★ they think we’re likely heading here
3
full recursive self-improvement

AI designs and refines its own successors

Progress paced only by compute. Humans move to oversight of an expanding “virtual lab.” The future they understand least — especially whether alignment holds, or whether rare misalignments compound as models build successors, until control slips.

the one they’re most uncertain about
07The ask · & reading it straight

Build the option to slow down — verifiably

The piece ends on policy, not product. A unilateral pause just changes who leads; what’s missing is the ability to verify others have actually slowed.

Why a credible pause is hard — and worth building toward

A slowdown that only lets the least cautious catch up leaves everyone less safe. So the goal is the option: systems that let frontier labs verify others have genuinely stopped. Anthropic says if such systems existed and peers paused verifiably, it expects it would too.

why it’s hard
Detection beats verification — and even that’s tough

Training runs are easier to conceal than missile silos, inputs are general-purpose, and whoever continues while others pause inherits the lead.

the precedent
We’ve done it before — slowly

Regimes like the INF Treaty built verification and trust over decades. The authors’ blunt line: “We don’t have that long.”

Reading it in proportion

  • This is one lab’s account of its own internal data — much previously unreported, not independently audited.
  • The soft spots are stated in the original: lines-of-code overstates productivity; the self-reported 4× is probably high; the headline research result didn’t transfer to production scale; the next-step test used cherry-picked moments.
  • “More autonomous” is not “fully autonomous” — every standout result still had a human framing the problem and defining success.
  • That the authors surface these caveats themselves — against their own incentive — is part of what makes the document serious.
ThorstenMeyerAI.com
Source: “When AI builds itself,” Marina Favaro & Jack Clark, The Anthropic Institute · data via METR, SWE-bench, CORE-Bench & Anthropic’s published research · figures per the piece · independent commentary.

Implications of AI-Driven Self-Development

This evidence suggests that AI systems are rapidly advancing in automating parts of their own development, which could lead to faster innovation cycles. If the decision-making gap narrows, it might enable AI to improve itself recursively, potentially accelerating progress beyond current expectations. For readers, understanding this trajectory is crucial as it impacts future AI safety, regulation, and the pace of technological change. However, the report emphasizes that full autonomous self-improvement remains a conditional possibility, not an imminent reality.

Current State of AI Self-Improvement Evidence

Anthropic’s analysis builds on public benchmarks like METR, SWE-bench, and CORE-Bench, which measure AI capabilities in coding, bug fixing, and research reproduction. These benchmarks show a clear upward trend in AI performance over recent years, with models like Claude demonstrating rapid capability gains. Internally, Anthropic’s data indicates that AI models are increasingly responsible for generating code, designing experiments, and even interpreting results, although human oversight remains essential for goal selection and strategic decisions.

This development occurs amid a broader context of AI capability acceleration, with other organizations also reporting rapid improvements. The report underscores that these trends are observable in public data and internal metrics, but the leap to fully autonomous AI self-improvement depends on overcoming persistent gaps in decision-making and strategic planning.

“The data shows AI is now capable of automating significant portions of its own development process, but the critical bottleneck—decision-making—remains human-controlled.”

— Thorsten Meyer, author of the report

Uncertainties About Autonomous Self-Improvement

It remains unclear when or if AI will be able to fully automate the decision-making process required for self-improvement. The report emphasizes that current progress is primarily in executing tasks, not in autonomous goal-setting or strategic planning. The timeline for overcoming these gaps is uncertain, and whether AI can reliably self-improve without human input is still an open question.

Next Steps in Monitoring AI Self-Development

Researchers and organizations will likely focus on developing benchmarks and internal metrics to better measure AI’s decision-making capabilities. Further transparency from labs about internal progress will be crucial, as well as cautious exploration of autonomous systems. The next milestones include demonstrating AI’s ability to autonomously select research goals and design experiments without human input, which remains a significant challenge.

Key Questions

What is recursive self-improvement in AI?

Recursive self-improvement refers to AI systems improving their own capabilities without human intervention, potentially creating a feedback loop of rapid advancement.

How close are we to AI fully automating its own development?

Current evidence shows significant progress in automating tasks within AI research, but the ability for AI to autonomously decide on goals and strategies remains unproven and uncertain.

What are the risks of AI self-improvement?

If AI systems can self-improve rapidly, it could lead to unpredictable or uncontrollable levels of intelligence, raising safety and ethical concerns. However, full self-improvement is not yet a reality.

What role do humans still play in AI research?

Humans are still responsible for setting research goals, interpreting results, and making strategic decisions, which are the key bottlenecks preventing full automation of AI development.

Will AI self-improvement happen soon?

The report suggests that while progress is accelerating, the timeline for autonomous self-improvement remains uncertain and likely still years away, depending on overcoming key decision-making challenges.

Source: ThorstenMeyerAI.com

This content is for general information only and is not financial, tax or legal advice. Consult a qualified professional for decisions about your money.
You May Also Like

732 Bytes to Root. One Hour of Scan Time.

A 732-byte Linux kernel exploit was identified in just one hour of scanning, collapsing the cost of zero-day vulnerabilities and raising security concerns.

Technology operations signal monitor: Show HN: Kage – Shadow any website to a single binary for offline viewing

Kage is a new tool that allows users to shadow any website into a single binary for offline access, aimed at product and engineering leads to monitor platform changes.

The 90-Day Window Closed. Nobody Sent a Notice.

The 90-day window for responsible vulnerability disclosure has effectively ended as no notices or patches have been sent, raising concerns over security risks.

The labor share. Is value really moving from labor to capital? The data isn’t on anyone’s side yet.

Analyzing whether AI is shifting value from labor to capital, with evidence showing stable aggregate labor share but rising early signals of displacement.