Retracted ChatGPT Education Study Raises AI Research Integrity Questions
Nearly a year after its release, a meta-analysis in Humanities and Social Sciences Communications asserting that OpenAI's ChatGPT enhances student learning has been withdrawn by Springer Nature. The retraction was detailed in a notice titled "Retraction Note: The effect of ChatGPT on students' learning performance, learning perception, and higher-order thinking — A meta-analysis," which pointed to "discrepancies" in the analysis and a lack of trust in its findings. The paper had gained hundreds of citations and was widely shared on social media. Ben Williamson, a senior lecturer at the University of Edinburgh's Centre for Research in Digital Education, remarked that the study made "very attention-grabbing claims" and was viewed as "one of the first pieces of hard, gold standard evidence" supporting the benefits of ChatGPT for learners. The analysis reviewed 51 prior studies to assess the impact of ChatGPT on various learning metrics, calculating effect sizes between experimental and control groups. This retraction underscores ongoing issues regarding research integrity within the fast-evolving AI education sector.
Key facts
- A meta-analysis on ChatGPT's impact on learning was retracted by Springer Nature.
- The retraction cited 'discrepancies' in the analysis and lack of confidence in conclusions.
- The paper had hundreds of citations and was widely shared on social media.
- Ben Williamson of the University of Edinburgh commented on the study's attention-grabbing claims.
- The study analyzed 51 previous research studies on ChatGPT in education.
- It calculated effect sizes between experimental and control groups.
- The retraction occurred nearly one year after publication.
- The paper was published in Humanities and Social Sciences Communications.
Entities
Institutions
- Springer Nature
- OpenAI
- Centre for Research in Digital Education
- Edinburgh Futures Institute
- University of Edinburgh
- Ars Technica
- Humanities and Social Sciences Communications
Locations
- Scotland