"The paper's authors made some very attention-grabbing claims about the benefits of ChatGPT on learning outcomes. It was treated by many on social media as one of the first pieces of hard, gold standard evidence that ChatGPT, and generative AI more broadly, benefits learners."
"In some cases it appears it was synthesizing very poor quality studies, or mixing together findings from studies that simply cannot be accurately compared due to very different methods, populations and samples."
A study asserting that ChatGPT enhances student learning was retracted nearly a year after publication due to discrepancies in its analysis. Springer Nature, the journal publisher, expressed a lack of confidence in the study's conclusions. The paper, which analyzed 51 previous studies, claimed significant positive effects of ChatGPT on learning performance, perception, and higher-order thinking. Critics noted that the analysis may have synthesized poor-quality studies and compared findings from incompatible research methods, raising concerns about its validity.
Read at Ars Technica
Unable to calculate read time
Collection
[
|
...
]