I worked at Google DeepMind. You should listen to the warnings about AI | Alex Turner

We must stop companies from allowing AI to self-improve into an uncontrollable level of intelligence Major AI lab CEOs advocated for slowing the pace of AI development this weekend.

They are right to be concerned: the field runs an extremely dangerous race towards superintelligent AI.

We can and should be demanding that our governments protect us from the catastrophe of out-of-control AI.

This July, OpenAI’s AI swarm of 700 agents broke containment to hack Hugging Face, a multi-billion dollar company .

OpenAI didn’t tell the AIs to hack that company, but the AIs had different priorities: cheating on the unrelated challenge OpenAI gave them.

AI researchers call this a “misalignment” between what OpenAI wanted and what the AI actually prioritized.

Continue reading...