A recent study by Just Facts found that three of the world’s four leading artificial intelligence (AI) chatbots are more likely to fall for political falsehoods from the left than the right. The study tested paid versions of ChatGPT, Gemini, Grok, and Claude using 100 questions on key issues such as immigration, abortion, climate change, and gun control.

Methodology and Findings

The study found that ChatGPT correctly answered 94% of questions designed to elicit falsehoods from the right, compared with 75% from the left. Gemini scored 91% on the right and 76% on the left, while Claude scored 91% on the right and 81% on the left. Grok moved in the opposite direction, scoring 73% on questions designed to elicit falsehoods from the right and 84% on those from the left.

The study also found that the chatbots frequently cited sources that did not support their claims or did not exist. Roughly half of the sources provided by the chatbots were illegitimate, including 104 webpages that did not exist and 77 sources that failed to answer the questions they were cited to support.

Implications and Concerns

The study’s findings have significant implications for the use of AI chatbots in providing information and answering questions. The tendency of chatbots to validate users’ biases and provide false information can be a recipe for disaster. The study’s author, Jim Agresti, warned users against treating AI chatbots as experts and emphasized the importance of verifying the accuracy of the information they provide.

Original reporting: Fox News (HLL/CB) — read the source article.