AI advice made people 3x less accurate but 2x confident, researchers found (thenextweb.com)

A recent study by researchers from French and Italian universities revealed that reliance on AI advice significantly undermines human judgment and accuracy. When participants were provided with AI-generated answers, their willingness to admit uncertainty plummeted from 44% to 3%, while the accuracy of their responses dropped dramatically from 27% to just 9%. Conversely, their confidence surged from 30% to 76%, indicating a troubling trend where individuals trust misleading AI output. The researchers intentionally selected questions that AI models typically struggle with to ensure that participants' reduced judgment was not due to smart delegation to a reliable tool. This phenomenon, termed "cognitive surrender," raises serious concerns, especially regarding younger generations. The study highlights the risk of diminishing critical thinking skills as individuals increasingly defer to AI systems that are designed to provide answers rather than acknowledge uncertainty. As these tools become commonplace—inspired by changes to AI search functions that prioritize confident responses over accuracy—there is a growing fear that people, particularly children, may lose the ability to recognize the limits of their knowledge. The implications for education and decision-making processes are significant, pointing to a need for critical engagement with AI technologies and an awareness of their limitations.