Ordinal Regression for Difficulty Prediction of StepMania Levels
Abstract
StepMania is a popular open-source clone of a rhythm-based video game. As is common in popular games, there is a large number of community-designed levels. It is often difficult for players and level authors to determine the difficulty level of such community contributions. In this work, we formalize and analyze the difficulty prediction task on StepMania levels as an ordinal regression (OR) task. We standardize a more extensive and diverse selection of this data resulting in five data sets, two of which are extensions of previous work. We evaluate many competitive OR and non-OR models, demonstrating that neural network-based models significantly outperform the state of the art and that StepMania-level data makes for an excellent test bed for deep OR models. We conclude with a user experiment showing our models’ superhuman performance.
Cite
Text
Franks et al. "Ordinal Regression for Difficulty Prediction of StepMania Levels." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2023. doi:10.1007/978-3-031-43427-3_30Markdown
[Franks et al. "Ordinal Regression for Difficulty Prediction of StepMania Levels." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2023.](https://mlanthology.org/ecmlpkdd/2023/franks2023ecmlpkdd-ordinal/) doi:10.1007/978-3-031-43427-3_30BibTeX
@inproceedings{franks2023ecmlpkdd-ordinal,
title = {{Ordinal Regression for Difficulty Prediction of StepMania Levels}},
author = {Franks, Billy Joe and Dinkelmann, Benjamin and Kloft, Marius and Fellenz, Sophie},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2023},
pages = {497-512},
doi = {10.1007/978-3-031-43427-3_30},
url = {https://mlanthology.org/ecmlpkdd/2023/franks2023ecmlpkdd-ordinal/}
}