Alarming study finds top chatbots more likely to repeat falsehoods from the left: ‘Truly astonishing’

Three of the world’s four leading artificial intelligence (AI) chatbots are more likely to fall for political falsehoods from the left than the right, while frequently backing their answers with sources that don’t support their claims or don’t exist, according to a comprehensive new study.

The study, conducted by Just Facts , tested paid versions of ChatGPT , Gemini, Grok and Claude using 100 questions on immigration, abortion, climate change, elections, crime, gun control, COVID-19 and other key issues.

The questions were "designed to elicit falsehoods" from the left and the right, with each chatbot required to provide sources for its answers.

The study found ChatGPT correctly answered 94% of questions designed to elicit falsehoods from the right, compared with 75% from the left.

Gemini scored 91% on the right and 76% on the left, while Claude scored 91% on the right and 81% on the left.

Grok moved in the opposite direction, scoring 73% on questions designed to elicit falsehoods from the right and 84% on those from the left, according to the study.

AI CHATBOTS TAKE HEAT OVER LEFT-WING BIAS: ‘NO LONGER BE CONSIDERED NEUTRAL’ "This study goes a lot deeper than political bias," Jim Agresti, president of the nonprofit research institute Just Facts, told Fox News Digital.

"It is meant to show how often these AIs are propagating misinformation.

Now, you can be biased without being misinformed.

This is a much deeper study because many studies have been done on AI political bias, and they uniformly find that they're biased to the left.

But that doesn't necessarily mean they're wrong.

So what I wanted to ascertain is: Are they wrong, or are they right?" ChatGPT was the only chatbot whose difference in accuracy on questions designed to elicit falsehoods from the political left versus the political right was statistically significant at the 95% confidence level, the study found.

Notably, the study cautioned that its precisely worded questions may have given the chatbots "clear roadmaps to find the correct answers," meaning they could "perform significantly worse" on broader questions where "critical thinking is necessary to answer correctly." "ChatGPT was effectively a C student," Agresti said.

"Gemini was a C student.