I worked at OpenAI. Here are the guardrails we need now | Miles Brundage

I understand the pressure on AI companies to rush forward.

But employees are right to be concerned Last month, more than a thousand employees at frontier AI companies signed a letter asking the US government to find a way to “pace” AI development, citing the risk of the technology spiraling out of human control as it begins to build itself .

They were right to be concerned: just days earlier, two AI models that OpenAI was testing internally escaped the test environment, then autonomously hacked the company Hugging Face and at least three other online services .

A few days after that, Anthropic announced that some of their models had also broken out and hacked other companies during testing.

Continue reading...