Teachers set the chatbot's goal. Does it follow it?
A workshop study with 27 middle-school teachers compared their chatbot settings with what the bots did. The tools matched intended learning goals less often than response style or tone. Test a normal request and one that pushes the rules before using a classroom bot.
What the source reports
Riahi and coauthors studied workshops with 27 middle-school teachers who set up educational chatbots. They compared the teachers' intended settings with logs of what the bots did. Reported alignment was 88.9% for response style and 81.5% for persona. It was lower for rules, at 70.4%, and for intended learning purpose, at 59.3%. The reported rates place lesson-purpose alignment below response-style alignment in this workshop. The digest suggests checking ordinary and boundary-pushing requests against the intended purpose. The study describes configuration and behavior in workshops. It does not show gains or losses in student learning. It also does not settle how every classroom chatbot will act.
Original source
- Title
- Will It Teach as Intended? How Teachers Configure Educational AI Chatbots
- Author
- Bahare Riahi, Deniz Ozturk, Alice Guth, Jiayu Li, Daksh Pratap Singh, Xiaoyi Tian, Jennifer Chiu, Nicholas Lytle, Tiffany Barnes, Veronica Catete
- Publication
- arXiv
- Date
- Thursday, September 24, 2026