What on earth is an 'embedded evaluator'? One of the most important jobs in AI, according to frontier lab chiefs.

AI chiefs are committing to a new role in their companies: embedded evaluators WEF Get ready to hear a lot about "embedded evaluators." Anthropic CEO Dario Amodei made the case for embedding independent AI auditors in frontier labs.

They'll have employee-like access, access badges, and company laptops, he said.

The next high-profile AI hire may not be another researcher, but an "embedded evaluator" tasked with scrutinizing frontier models before they're released.

In a blog post on Saturday, Anthropic CEO Dario Amodei said frontier AI labs should commit to embedding independent safety evaluators within their organizations.

The embedded evaluators' job is to check whether the company "is actually following the training, deployment, operational, and safeguards practices they claim to be following," Amodei wrote.

He said embedded evaluators will have "employee-like access to verify safety practices and report incidents." They will have desks in the Anthropic offices, access badges, and company laptops, as well as the right to publish any findings without Anthropic's editorial control.

Amodei's plan comes as fears of an AI apocalypse reach a fever pitch, and it received an outpouring of support, even from executives he's feuded with.

OpenAI CEO Sam Altman , reposting Amodei's X post, wrote: "Committing to having independent evaluators with employee-like access is a great idea, and we will do the same." SpaceXAI CEO Elon Musk also reposted Amodei's post, adding: "Dario is right." The idea has also received some VC attention.

Sriram Krishnan, a former Andreessen Horowitz partner and former AI advisor to President Donald Trump, spoke about the importance of a distributed network of evaluators.

"The more eyes and people with distributed skill sets the better," Krishnan said in a Saturday X post.

"It would be a good idea to fund several efforts on this." Top AI talent is migrating to this space Amodei already has candidates in mind for the new job.

In his post, he mentioned Berkeley-based Metr , a prominent nonprofit AI watchdog that conducts independent evaluations of AI models.

Metr, established in 2022 by ex-OpenAI staffer Beth Barnes, is attracting top talent from the biggest AI labs.

Joe Benton, previously a member of Anthropic's safety and oversight team, announced on Friday that he had left the company to join Metr.