Study 1
Standard GPT-4 helped in practice, then hurt on the exam.
Grades indexed to 100 for students who never used AI. While practising with AI: standard GPT-4 148, an increase of 48%; the tutor with guardrails 227, an increase of 127%. On the exam without AI: standard GPT-4 83, 17% lower; the tutor with guardrails about the same as no AI, as the harm was largely removed, as reported.
Bastani et al., “Generative AI without guardrails can harm learning: Evidence from high school mathematics”, PNAS 122(26), 2025 · Field experiment, nearly 1,000 high-school maths students
Read the paper by Bastani et al. (opens in a new tab)