What's Most Broken? a Tool to Assist Data-Driven Iterative Improvement of an Intelligent Tutoring System
Abstract
Intelligent Tutoring Systems (ITS) have great potential to change the educational landscape by bringing scientifically tested one-to-one tutoring to remote and under-served areas. However, effective ITSs are too complex to perfect. Instead, a practical guiding principle for ITS development and improvement is to fix what’s most broken. In this paper we present SPOT (Statistical Probe of Tutoring): a tool that mines data logged by an Intelligent Tutoring System to identify the ‘hot spots’ most detrimental to its efficiency and effectiveness in terms of its software reliability, usability, task difficulty, student engagement, and other criteria. SPOT uses heuristics and machine learning to discover, characterize, and prioritize such hot spots in order to focus ITS refinement on what matters most. We applied SPOT to data logged by RoboTutor, an ITS that teaches children basic reading, writing and arithmetic.
Cite
Text
Goswami et al. "What's Most Broken? a Tool to Assist Data-Driven Iterative Improvement of an Intelligent Tutoring System." AAAI Conference on Artificial Intelligence, 2019. doi:10.1609/AAAI.V33I01.33019941Markdown
[Goswami et al. "What's Most Broken? a Tool to Assist Data-Driven Iterative Improvement of an Intelligent Tutoring System." AAAI Conference on Artificial Intelligence, 2019.](https://mlanthology.org/aaai/2019/goswami2019aaai-most/) doi:10.1609/AAAI.V33I01.33019941BibTeX
@inproceedings{goswami2019aaai-most,
title = {{What's Most Broken? a Tool to Assist Data-Driven Iterative Improvement of an Intelligent Tutoring System}},
author = {Goswami, Mononito and Mian, Shiven and Mostow, Jack},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2019},
pages = {9941-9942},
doi = {10.1609/AAAI.V33I01.33019941},
url = {https://mlanthology.org/aaai/2019/goswami2019aaai-most/}
}