Study Finds Generative AI Could Inhibit Critical Thinking

A study on how knowledge workers engage in critical thinking recently found that workers with higher confidence in generative AI technology tend to employ less critical thinking to AI-generated outputs than workers with higher confidence in personal skills, who tended to apply more critical thinking to verify, refine, and critically integrate AI responses.

The study ("The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers"), conducted by Microsoft Research and Carnegie Mellon University scientists, surveyed 319 knowledge workers who reported using AI tools such as ChatGPT and Copilot at least once a week. The researchers analyzed 936 real-world examples of AI-assisted tasks.

"[W]e find that knowledge workers engage in critical thinking primarily to ensure the quality of their work," the researchers wrote, "e.g. by verifying outputs against external sources. Moreover, while gen AI can improve worker efficiency, it can inhibit critical engagement with work and can potentially lead to long-term overreliance on the tool and diminished skill for independent problem solving."

According to the researchers, gen AI is eroding critical thinking by fundamentally changing how professionals deal with certain business tasks, specifically in these three areas:

  • Information gathering and verification: AI automates the retrieval and organization of data, reducing the effort needed to find information. However, workers must now spend more time verifying AI-generated content for accuracy and reliability.
  • Problem-solving and AI response integration: Instead of solving problems independently, workers focus on refining and adapting AI outputs to meet their specific needs, including adjusting tone, context, and relevance.
  • Task execution and task stewardship: Rather than performing tasks directly, workers oversee AI processes, guiding and evaluating outputs to ensure quality. While gen AI handles routine work, responsibility and accountability remain with human users.

While gen AI reduces cognitive effort in some areas, it increases the need for verification, integration, and oversight, reinforcing the importance of maintaining critical thinking skills. For this effort, researchers suggest future development of gen AI tools to facilitate higher critical thinking. This can be done by integrating feedback mechanisms that can help users gauge the reliability of gen AI outputs. Further, tools should be designed to customize AI assistance levels, based on a user's task confidence and expertise.

"We find that knowledge workers often refrain from critical thinking when they lack the skills to inspect, improve, and guide AI-generated responses," the researchers wrote. "GenAI tools could incorporate features that facilitate user learning, such as providing explanations of AI reasoning, suggesting areas for user refinement, or offering guided critiques."

The full report is available on the Microsoft site here.

About the Author

Chris Paoli (@ChrisPaoli5) is the associate editor for Converge360.

Featured

  • digital illustration of Estonia with glowing neural network-like connections spreading across the map

    Estonia to Roll Out ChatGPT Edu for all Secondary Schools

    In a nationwide artificial intelligence program dubbed "AI Leap 2025," the country of Estonia plans to provide free access to leading AI applications for all secondary school students and teachers. The initiative will launch with a rollout of ChatGPT Edu to 20,000 high school students in grades 10-11 and their 3,000 teachers, beginning Sept. 1.

  • A child surrounded by glowing, fluid virtual patterns and holographic shapes, illuminated in a dark gradient environment of blue, purple, and pink.

    ClassVR Gets Expanded VR/AR Content Library

    Avantis Education has announced a new content library for its ClassVR virtual and augmented reality platform. Dubbed Eduverse+, the library features four content suites — EduverseAI, WildWorld, STEAM3D, and CareerHub — that can be tailored to suit a variety of educational levels.

  • elementary school teacher with students

    Traditional Procurement Processes Stand in the Way of Progress

    K–12 schools and districts can streamline procurement and gain agility without having the rewrite purchasing requirements.

  • school building split in half, with one side collapsing into a dark hole

    Office of Educational Technology, National Center for Education Statistics Fall Victim to ED Cuts

    The U.S. Department of Education has announced cuts of nearly half of its staff, numbering more than 1,300 workers, according to AP reporting. While official details on the cuts are not available, early commentary on LinkedIn has revealed drastic cuts in the areas of educational technology and data.