Anthropic Researcher Resigns Over Extinction Risks, Warns Against Self-Improving AI
Original title:‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AI
Anthropic researcher Jacob Coxon has resigned from the frontier AI lab, citing grave concerns over the existential risks posed by self-improving artificial intelligence. Coxon urged leading AI labs to negotiate shared pacing agreements to prevent an unchecked race toward recursively self-enhancing systems. As organizations push toward automated capability leaps, his departure underscores the growing friction between competitive acceleration and internal safety boundaries.
Why it's worth reading
As frontier labs target recursive self-improvement, this insider departure highlights the deepening rift between competitive capability races and calls for collective safety pacing.