HeadlinesBriefing favicon HeadlinesBriefing.com

Retracted study claimed ChatGPT boosts learning

Ars Technica •
×

Springer Nature has pulled a paper that lauded OpenAI’s ChatGPT as a learning booster, retracting it almost a year after the May 6, 2025 release in Humanities & Social Sciences Communications. The journal cited analytical discrepancies and a lack of confidence in the conclusions. Before the withdrawal, the study circulated widely on social media as early “hard evidence” of generative AI’s classroom benefits across academic circles and policy.

The retracted meta‑analysis pooled results from 51 prior studies, comparing experimental groups that used the chatbot with control groups that did not. Authors claimed a large positive effect on learning performance, a moderate boost to perception, and enhanced higher‑order thinking. Edinburgh scholar Ben Williamson warned the sample mixed low‑quality research and incomparable methodologies, and diverse student populations, as calling the publication premature.

Since appearing, the article amassed 262 citations in Springer‑affiliated journals and 504 citations overall, drawing nearly half a million readers and ranking in the 99th percentile for attention scores. Its removal underscores how quickly unvetted AI hype can infiltrate scholarly discourse, reminding educators and researchers to scrutinize methodology before citing AI‑related findings for future curriculum design decisions.