This new theory on how AI ‘thinks’ could impact whether it kills us all

AI neurons and their connections are easier to understand than we thought, according to a researcher's new findings. : Sergi Reboredo/VW Pics/Universal Images Group via Getty Images AI researchers don't really know how the models they are building "think." They know what goes into them and what comes out, but that's about it.

A new theory may change that, allowing safety researchers to prevent them from going off the rails.

How AI models think may be easier to decipher than we thought.

An independent researcher who formerly worked at OpenAI published a report on Thursday that some in the AI world are describing as a bombshell.

It could have implications as safety researchers scramble to get the jump on AI models that may not have humanity's best interests in mind.

Previously, the prevailing wisdom was that AI "neurons," which, like those in a human brain, light up when an AI model encounters specific stimuli, were ultimately uninterpretable — meaning, basically, that there was no way to guess why a specific neuron would fire when an AI model was exposed to, say, a picture of a cat.

Those building AI models at places like OpenAI and Anthropic don't write instructions for everything a model does.

Instead, they train neurons to respond to information and influence one another.

As the AI learns, it develops its own ways of processing that information, and humans have not yet cracked the code of how it works.

That means those building AI models know what goes into the AI and what comes out, but not necessarily what happens in between.

So if an AI goes rogue , they don't always know why.

The author of the new report, however, says he may have discovered patterns in how the neurons react to stimuli that make sense.

Nick Cammarata, who said he left OpenAI in 2023, said AI neural networks are knowable, so long as you look carefully.

In one example, he says that a single AI neuron might react to both a cat and the front of a car.