Can AI make you less gullible or is it a conspiracy?

Fake News
(Image credit: Shutterstock)

AI chatbots may struggle with hallucinating made-up information, but new research has shown they might be useful for pushing back against unfounded and hallucinatory ideas in human minds. MIT Sloan and Cornell University scientists have published a paper in Science claiming that conversing with a chatbot powered by a large language model (LLM) reduces belief in conspiracies by about 20%. 

To see how an AI chatbot might affect conspiratorial thinking, the scientist arranged for 2,190 participants to discuss conspiracy theories with a chatbot running OpenAI's GPT-4 Turbo model. Participants were asked to describe a conspiracy theory they found credible, including the reasons and evidence they believed supported it. The chatbot, prompted to be persuasive, provided responses tailored to these details. As they talked to the chatbot, it provided tailored counterarguments based on the participants' input. The study fielded the perennial AI hallucination issue with a professional fact-checker evaluating 128 claims made by the chatbot during the study. The claims were 99.2% accurate, which the researchers said was thanks to extensive online documentation of conspiracy theories represented in the model's training data.

The idea of turning to AI for debunking conspiracy theories was that their deep information reservoirs and adaptable conversational approaches could reach people by personalizing the approach. Based on follow-up assessments ten days and two months after the first conversation, it worked. Most participants had a reduced belief in the conspiracy theories they had espoused " from classic conspiracies involving the assassination of John F. Kennedy, aliens, and the Illuminati, to those pertaining to topical events such as COVID-19 and the 2020 US presidential election," the researchers found.

Factbot Fun

The results were a real surprise to the researchers, who had hypothesized that people are largely unreceptive to evidence-based arguments debunking conspiracy theories. Instead, it shows that a well-designed AI chatbot can present counterarguments effectively, leading to a measurable change in belief. They concluded that AI tools could be a boon in combatting misinformation, albeit one that requires caution due to how it could also further mislead people with misinformation.

The study supports the value of projects with similar goals. For instance, fact-checking site Snopes recently released an AI tool called FactBot to help people figure out whether something they've heard is real or not. FactBot uses Snopes' archive and generative AI to answer questions without having to comb through articles using more traditional search methods. Meanwhile, The Washington Post created Climate Answers to clear up confusion on climate change issues, relying on its climate journalism to answer questions directly on the topic.  

"Many people who strongly believe in seemingly fact-resistant conspiratorial beliefs can change their minds when presented with compelling evidence. From a theoretical perspective, this paints a surprisingly optimistic picture of human reasoning: Conspiratorial rabbit holes may indeed have an exit," the researchers wrote. "Practically, by demonstrating the persuasive power of LLMs, our findings emphasize both the potential positive impacts of generative AI when deployed responsibly and the pressing importance of minimizing opportunities for this technology to be used irresponsibly."

You Might Also Like

Eric Hal Schwartz
Contributor

Eric Hal Schwartz is a freelance writer for TechRadar with more than 15 years of experience covering the intersection of the world and technology. For the last five years, he served as head writer for Voicebot.ai and was on the leading edge of reporting on generative AI and large language models. He's since become an expert on the products of generative AI models, such as OpenAI’s ChatGPT, Anthropic’s Claude, Google Gemini, and every other synthetic media tool. His experience runs the gamut of media, including print, digital, broadcast, and live events. Now, he's continuing to tell the stories people want and need to hear about the rapidly evolving AI space and its impact on their lives. Eric is based in New York City.

Read more
A hand reaching out to touch a futuristic rendering of an AI processor.
What are AI Hallucinations? When AI goes wrong
Woman using a mobile phone with ChatGPT on the screen.
Can ChatGPT really replace a therapist? We spoke to mental health experts to find out
EDMONTON, CANADA - FEBRUARY 10: A woman uses a cell phone displaying the Open AI logo, with the same logo visible on a computer screen in the background, on February 10, 2025, in Edmonton, Canada
I asked ChatGPT to work through some of the biggest philosophical debates of all time – here’s what happened
Man with headache
I asked ChatGPT to invent 6 philosophical thought experiments – and now my brain hurts
Bored frustrated business people working in the office with an efficient robot.
Shut it all down? Microsoft research suggests AI usage is making us feel dumber – but you don't need to panic yet
ChatGPT app on an iPhone
ChatGPT and Google Gemini are terrible at summarizing news, according to a new study
Latest in Artificial Intelligence
Google Gemini Flash 2.0 Images
I tried Gemini's new AI image generation tool - here are 5 ways to get the best art from Google's Flash 2.0
Voice cloning
I cloned my voice in seconds using a free AI app, and we really need to talk about speech synthesis
Google Gemini AI logo on a smartphone with Google background
I made an AI version of Bilbo Baggins using Goggle Gemini for free, and shared a pipe with him outside Bag End – here’s what you can now do with Gems
Gemini 2.0
Gemini Deep Research just got even smarter and it’s now free for everyone to try - here's why you should give it a go
Google Gemini with Search history access. Image says "Get help from AI that gets you"
Google just gave Gemini a superpower by allowing it to access your Search history - here's why I'm excited and also a little terrified
AI tools.
I've tested all the best AI agents including ChatGPT Deep Research and Gemini - these are the 5 top automated artificial intelligence tools you can try right now
Latest in News
Google Gemini Flash 2.0 Images
I tried Gemini's new AI image generation tool - here are 5 ways to get the best art from Google's Flash 2.0
An image of the Samsung Galaxy S25 Ultra from a hands-on event
Samsung Galaxy S26 Ultra could resurrect an intriguing camera feature
Eurocom Raptor X18
At $15,000, this massive 256GB RAM laptop makes Apple's MacBook Pro look affordable, tiny and very, very slow
Cristin Milioti in Black Mirror season 7
Netflix launches trailer for Black Mirror season 7, giving us a look at its first-ever sequel episode and an unexpected returning character
A graphic of the PC Gaming Show
Get ready for a bounty of PC games on June 8, as the PC Gaming show is back
A close up of The Daily podcast from Pocket Casts' web page
‘Podcasting shouldn’t be locked behind walled gardens’: Pocket Casts slams Spotify and makes its web player free to all