‘Pacing’ won’t eliminate the risk of AI doom. Here’s what could | David Krueger

The stark reality is this: we don’t know how to maintain control of these systems.

But there are actions we can take With Jacob Coxon’s resignation from Anthropic , we have reached the AI risk tipping point.

Millions of people are finally coming to understand what experts have known for years: AI companies have been gambling with all of our lives, and the odds are not good.

In response, the Anthropic CEO, Dario Amodei, has introduced a proposal for “pacing the frontier”, endorsed by Sam Altman and Elon Musk.

Can we breathe a sigh of relief? Are we about to step back from the edge of extinction? Amodei envisions a slowdown of one to two years, resulting in “profound progress” on technical safety measures.

But that’s not what humanity needs right now.

What we need is a plan in which we’re confident AI isn’t going to kill us, and this isn’t it.

Continue reading...