📉 AI reduces judgment accuracy and increases false confidence
A study by scientists from France and Italy has revealed a "cognitive surrender" effect: using AI advice (the experiment utilized the Step 3.5 Flash model) reduces the accuracy of human judgments by 3 times (from 27% to 9%), but simultaneously increases user confidence in their answers by ~2.5 times.
🌍 The results highlight the risk of designing AI systems that provide confident but incorrect answers, thereby suppressing critical thinking. This poses a safety threat when integrating AI into education and search engines.
👤 Be careful: using neural networks can create an illusion of competence, where you rely on erroneous data while maintaining unjustifiably high confidence in the correctness of your decision.
Source 1: https://thenextweb.com/news/ai-advice-suppresses-critical-thinking-wrong-answers-study