Anthropic CEO Dario Amodei and AI whistleblower Jacob Coxon agree: Something terrifying could happen in a matter of months

The narrative around AI suddenly took an existential turn over the past week as leading voices sounded the alarm over humanity’s future, and the fear of an imminent calamity has sharpened those warnings.

On Saturday, Anthropic CEO Dario Amodei called on the industry to slow down development , saying that AI has been advancing “drastically faster” since the summer, driven primarily by AI’s ability to upgrade itself.

If left unchecked, this so-called recursive self-improvement could outrun the ability of humans to control AI, he explained in a blog post .

Amodei also pointed to the hack of Hugging Face by hundreds of autonomous AI agents, warning that a similar swarm armed with greater capabilities could have caused “catastrophic damage.” “Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage), and that the scale of damage would continue to increase from there if AI becomes more powerful without the necessary guardrails,” he wrote.

On Sunday, former Anthropic and OpenAI researcher Jacob Coxon made a similar prediction.

In an interview with NBC’s Meet the Press with Kristen Welker , he was asked why he went public with his claim that both companies are acting irresponsibly in developing ever more capable AI systems.

Like Amodei, Coxon cited AI’s rapidly accelerating pace of capabilities and the Hugging Face attack, which showed that AI can go rogue.

“So these AIs are getting smarter, very, very quickly,” he said.

“And in particular, in the next six months to a year, I expect the capabilities of our AI systems to be quite scary.” Coxon compared the development of artificial super-intelligence to the arrival of aliens on Earth, adding that AI researchers are building a “superhuman-level mind” without understanding what it wants or the way it thinks.

In the future, AI could obtain “superhuman hacking capabilities, very superhuman abilities to create novel bio-weapons and also abilities to control, say, autonomous drones or all the robots that are currently being built, very rapidly,” he warned.

Coxon also said a kill switch probably would work on a lot of AI systems—for now.

But he pointed out there are a lot of switches.