A new study from the Massachusetts Institute of Technology has found that over-reliance on chatbots can diminish critical-thinking skills and potentially decrease the ability to discern misinformation. As AI tools become more sophisticated, manipulated images and misleading headlines are increasingly common. While AI can help identify fake content, the research suggests there is a cost to using it this way.
Study Details and Findings
During the four-week study, released in April, researchers tracked 67 participants and quizzed them on whether pairs of news-related headlines and images were real. They found that AI assistants like Claude and ChatGPT were useful for detecting fake news, but when participants relied on them too much, they became worse at spotting misinformation.
Researchers also found that AI often prioritized an accurate response over cultivating critical thinking. This dependency could worsen judgment in the long term, according to the study. “When we’re interacting with AI, we feel we’re becoming better at certain tasks and there’s enough research that shows we are not,” said Anku Rani, a PhD student at MIT and co-lead author.
Impact on Performance
Participants responded to questions about fake news and images with and without the help of an AI assistant running on GPT-4o integrated with Google search. The chatbot could hint at clues; for example, it advised a user to examine a police badge that revealed an image was fake.
The study evaluated how helpful AI was in guiding accurate decisions and how independent judgment changed over time. They found a trade-off: AI helped participants better discern what’s real, resulting in a 21% higher chance of making the right call. However, their unassisted performance when reviewing new images without AI grew 15.3% worse in the fourth week. “These results indicate that while AI may help immediately, it may ultimately degrade long-term misinformation detection abilities,” the study noted.
Broader Context and Concerns
Concerns about over-dependence on technology are not new. Calculators and GPS devices have dulled mental math and navigation skills. A 2025 Lancet study found that doctors using AI classification tools to detect cancer eventually became worse at doing so on their own. A neuroscientist at the Possibility Institute recently warned that diverting too much thinking to AI can weaken the brain’s defenses against dementia.
AI Approach Matters
The MIT study notes that an AI system’s approach—whether prescriptive or probing—affects a user’s ability to maintain good judgment. Although users often seek speed and certainty, more nuanced, guided questioning can improve critical thinking. Participants who use AI systems that tell them what to do often “go along with the system because it sounds knowledgeable,” the study adds. About one-quarter of participants thought their detection skills were improving, even when their performance was getting worse.
Limitations and Implications
The MIT study has limitations. The authors acknowledge participants were predominantly from the US and UK, and a more diverse sample could indicate whether skill degradation occurs across cultures and educational systems. Longer studies could also shed light on whether over-reliance effects continue at the same rate.
Researchers say the results are especially important for educators increasingly relying on AI for learning tools. The observations are also relevant for the broader public, given an inundation of dubious online information. “As AI becomes increasingly sophisticated, ensuring these tools build critical thinking skills rather than cognitive dependency becomes essential for maintaining public resilience to misinformation,” the study notes.
