Feedback can change how people check AI advice
When people overruled AI advice, the kind of feedback they got shaped how they thought about the next choice. One-sided feedback raised a risk of less reflection during that choice. Balanced feedback did not show the same risk. In this study of 244 people, overall team results did not improve.
What the source reports
A preprint by Holstein and colleagues reports a study with 244 people. It looked at feedback given after a person overruled AI advice. The feedback changed later reflection and how much people relied on the AI. One-sided feedback raised a risk that people would think less during the next choice. Balanced feedback did not show that risk. Overall team results stayed the same. The study was not done in a classroom or an AI tutoring program. It gives us a question to test about feedback, not proof of a school outcome.
Original source
- Title
- Think Once, Reflect Twice: How Feedback Shapes Human-AI Collaboration
- Author
- Joshua Holstein, Philipp Spitzer, Sebastian Schäfer, Maximilian Förster, Gerhard Satzger
- Publication
- arXiv
- Date
- Wednesday, October 14, 2026
Also covered by the other newsletter.