Learning Model Agnostic Explanations via Constraint Programming
Abstract
Interpretable Machine Learning faces a recurring challenge of explaining the predictions made by opaque classifiers such as ensemble models, kernel methods, or neural networks in terms that are understandable to humans. When the model is viewed as a black box, the objective is to identify a small set of features that jointly determine the black box response with minimal error. However, finding such model-agnostic explanations is computationally demanding, as the problem is intractable even for binary classifiers. In this paper, the task is framed as a Constraint Optimization Problem, where the constraint solver seeks an explanation of minimum error and bounded size for an input data instance and a set of samples generated by the black box. From a theoretical perspective, this constraint programming approach offers PAC-style guarantees for the output explanation. We evaluate the approach empirically on various datasets and show that it statistically outperforms the state-of-the-art heuristic Anchors method.
Cite
Text
Koriche et al. "Learning Model Agnostic Explanations via Constraint Programming." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2024. doi:10.1007/978-3-031-70359-1_26Markdown
[Koriche et al. "Learning Model Agnostic Explanations via Constraint Programming." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2024.](https://mlanthology.org/ecmlpkdd/2024/koriche2024ecmlpkdd-learning/) doi:10.1007/978-3-031-70359-1_26BibTeX
@inproceedings{koriche2024ecmlpkdd-learning,
title = {{Learning Model Agnostic Explanations via Constraint Programming}},
author = {Koriche, Frédéric and Lagniez, Jean-Marie and Mengel, Stefan and Tran, Chi},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2024},
pages = {437-453},
doi = {10.1007/978-3-031-70359-1_26},
url = {https://mlanthology.org/ecmlpkdd/2024/koriche2024ecmlpkdd-learning/}
}