Research & Science

In a small AI pilot, critical thinking scores did not rise

A 14-person pilot asked learners to explain why they rejected an AI suggestion. Some statistics measures rose, but a standard critical-thinking score did not. The small sample limits broader claims.

Beyond Prompting
Read original source

What the source reports

In a small pilot, learners used AI as a thinking partner. They explained why they rejected some AI suggestions. The study included 14 people. Scores on some statistics measures rose. A standard test of critical thinking did not show a gain. The mixed results from a small group do not show that this approach works for all learners. Asking students to explain a rejected suggestion is the method being tested. It is not a proven fix.

Original source

Title
Critical Thinking with Generative AI: A Constraint-First Design Pilot of a Thinking-Partner Intervention
Author
Fatima Tuz Zahra, Jiangen He, David M. Bowers, Wei Wang
Publication
arXiv
Date
Tuesday, September 29, 2026