MathMistake Checker: A Comprehensive Demonstration for Step-by-Step Math Problem Mistake Finding by Prompt-Guided LLMs
Abstract
We propose a novel system, MathMistake Checker, designed to automate step-by-step mistake finding in mathematical problems with lengthy answers through a two-stage process. The system aims to simplify grading, increase efficiency, and enhance learning experiences from a pedagogical perspective. It integrates advanced technologies, including computer vision and the chain-of-thought capabilities of the latest large language models (LLMs). Our system supports open-ended grading without reference answers and promotes personalized learning by providing targeted feedback. We demonstrate its effectiveness across various types of math problems, such as calculation and word problems.
Cite
Text
Zhang et al. "MathMistake Checker: A Comprehensive Demonstration for Step-by-Step Math Problem Mistake Finding by Prompt-Guided LLMs." AAAI Conference on Artificial Intelligence, 2025. doi:10.1609/AAAI.V39I28.35382Markdown
[Zhang et al. "MathMistake Checker: A Comprehensive Demonstration for Step-by-Step Math Problem Mistake Finding by Prompt-Guided LLMs." AAAI Conference on Artificial Intelligence, 2025.](https://mlanthology.org/aaai/2025/zhang2025aaai-mathmistake/) doi:10.1609/AAAI.V39I28.35382BibTeX
@inproceedings{zhang2025aaai-mathmistake,
title = {{MathMistake Checker: A Comprehensive Demonstration for Step-by-Step Math Problem Mistake Finding by Prompt-Guided LLMs}},
author = {Zhang, Tianyang and Jiang, Zhuoxuan and Zhang, Haotian and Lin, Lin and Zhang, Shaohua},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2025},
pages = {29730-29732},
doi = {10.1609/AAAI.V39I28.35382},
url = {https://mlanthology.org/aaai/2025/zhang2025aaai-mathmistake/}
}