AI fact-checking tools help spot misinformation but weaken your ability to do it independently

If you're using AI tools like ChatGPT to fact-check news, there's some bad news for you

AI fact-checking your news might be the digital version of "trust me bro" As artificial intelligence becomes a go-to tool for everything from homework to workplace research, many people are also turning to chatbots like ChatGPT, Gemini, Claude, and Grok to verify whether news stories are true. But new research suggests that habit could actually make people worse at spotting misinformation over time. A new study from the MIT Media Lab found that relying on AI to determine whether news is accurate can weaken a person's ability to independently identify fake or misleading content. Researchers compared the effect to GPS navigation systems, which make travel easier but can gradually reduce a person's natural sense of direction. In a similar way, AI tools may make fact-checking more convenient while quietly eroding critical thinking skills. Recommended Videos The findings arrive at a time when AI-powered search and chatbots are increasingly being used as alternatives to traditional search engines. As AI-generated summaries become more common across the web, questions about accuracy, bias, and overreliance are becoming harder to ignore. AI may be making users less effective at spotting misinformation According to MIT researchers, participants who relied heavily on AI assistance became less capable of evaluating the credibility of news stories on their own. The concern is not simply that AI can occasionally make mistakes, but that users may begin outsourcing their judgment to the technology instead of actively assessing information themselves. That concern is reinforced by a growing body of research examining AI's role in fact-checking. Previous studies have found that large language models can struggle to consistently verify information, particularly when dealing with nuanced topics, political claims, or rapidly changing news events. Researchers have also noted significant variation in performance across different AI models and subject areas. Another challenge is that AI systems often present answers confidently, even when those answers are incomplete or incorrect. This can create a false sense of trust, especially when users treat chatbots as authoritative sources rather than assistants that still require verification. The MIT researchers argue that while AI can help summarize information or surface relevant context, it should not replace independent evaluation and media literacy skills. The problem isn't just accuracy - it's dependency The broader issue highlighted by the study is dependency. If users increasingly rely on AI to determine what is true, they may become less practiced at evaluating sources, checking evidence, and recognizing misleading narratives themselves. That risk becomes particularly important as AI tools become integrated into search engines, social media platforms, browsers, and operating systems. Instead of actively comparing multiple sources, users may be tempted to accept a chatbot's answer as the final word. Researchers are not suggesting that AI has no role in fact-checking. In many cases, AI can help users quickly gather information, summarize complex topics, or identify additional sources worth reviewing. However, the study suggests that the best results come when AI serves as a research assistant rather than a replacement for human judgment. The takeaway is simple: AI can help you investigate the news, but it may not be the best tool to decide what is true on your behalf. As chatbots become more powerful and more persuasive, maintaining healthy skepticism may become just as important as having access to the technology itself.

AI Helped People Spot Fake News -- Then Made Them Worse at It: MIT

The study comes as social media platforms, including X, work to crack down on AI-generated war footage. People using AI to evaluate the accuracy of news stories may become less effective at spotting misinformation on their own, according to new research from MIT's Media Lab. According to MIT researchers, the study comes as AI chatbots are increasingly being used to verify information online, raising questions about whether the tools help users develop critical thinking skills or simply outsource the task to AI. "AI assistants such as ChatGPT, Claude, and Grok are increasingly used to evaluate the credibility of online information, from judging the authenticity of news headlines and viral images to answering whether medical claims or political rumors are true," researchers wrote. "While recent research suggests such systems can reduce belief in specific false claims, it remains unclear whether these conversations teach humans to detect misinformation or merely shift beliefs about false information with AI assistance." In a four-week study involving 67 participants, 7,203 AI conversations, and 4,536 news-authenticity judgments, researchers assessed how people evaluated real and fake news headlines and images. They found that while AI assistance improved misinformation detection accuracy by 21%, participants' performance on new evaluations without AI fell by 15.3%. To conduct the study, researchers built a system that combined OpenAI's GPT-4o with Google Search to help participants evaluate news stories. Participants first judged whether a headline and image were real or fake on their own, then discussed the item with GPT-4o before making a final assessment. Researchers later tested them on new, unseen content without AI assistance to determine whether their misinformation-detection skills had improved or declined. Afterward, the team used Anthropic's Claude 3.5 Sonnet to analyze thousands of conversations between users and the AI. Because the study used the older GPT-4o and Claude 3.5 Sonnet, it's unclear whether newer AI models like GPT-5.5 or Claude Opus 4.8 with stronger reasoning capabilities would have produced similar outcomes. The decline was driven largely by a reduced ability to identify fake news, while accuracy on real news remained the same. Researchers suggest that while AI can improve performance in the moment, it also may encourage reliance on the technology. "Our longitudinal analysis demonstrates that current approaches prioritize belief correction over skill development, creating dependency rather than durable discernment capabilities," the study said. "As AI becomes increasingly sophisticated, ensuring these tools build critical thinking skills rather than cognitive dependency becomes essential for maintaining public resilience to misinformation." The study comes as generative AI has made it easier than ever to create convincing fake news, with realistic images and videos that can spread rapidly across social media and exploit people's tendency to trust what they see. Following Iranian missile strikes against Israel in June 2025, videos purporting to show destruction in Tel Aviv and at Ben Gurion Airport spread widely across social media, gaining millions of views before they were identified as AI-generated. Concern over the spread of fake war footage continued, leading to X announcing in March that it would suspend creators from its revenue-sharing program for posting AI-generated conflict videos without disclosure. "During times of war, it is critical that people have access to authentic information on the ground," X Head of Product Nikita Bier wrote. "With today's AI technologies, it is trivial to create content that can mislead people."