ML Anthology

Subgroup Harm Assessor: Identifying Potential Fairness-Related Harms and Predictive Bias

Adam Dubowski, Hilde J. P. Weerts, Anouk Wolters, Mykola Pechenizkiy
ECML-PKDD 2024 pp. 413-417
doi:10.1007/978-3-031-70371-3_31 /ecmlpkdd/2024/dubowski2024ecmlpkdd-subgroup/

Abstract

With the integration of artificial intelligence into real-world decision-support systems, there is increasing interest in tools that facilitate the identification of potential biases and fairness-related harms of machine learning models. While existing toolkits provide approaches to evaluate harms associated with discrete predicted outcomes, the assessment of disparities in epistemic value provided by continuous risk scores is relatively underexplored. Additionally, relatively few works focus on identifying the biases at the root of the harm. In this work, we present a visual analytics “Subgroup Harm Assessor” tool that allows users to: (1) identify disparities in the epistemic value of risk-scoring models via subgroup discovery of disparities in model log loss, (2) evaluate the extent to which the disparity might be caused by disparities in the informativeness of features via SHapley Additive exPlanations (SHAP) of model loss.

PDF ECML-PKDD Semantic Scholar

Cite

Text

Dubowski et al. "Subgroup Harm Assessor: Identifying Potential Fairness-Related Harms and Predictive Bias." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2024. doi:10.1007/978-3-031-70371-3_31

Markdown

[Dubowski et al. "Subgroup Harm Assessor: Identifying Potential Fairness-Related Harms and Predictive Bias." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2024.](https://mlanthology.org/ecmlpkdd/2024/dubowski2024ecmlpkdd-subgroup/) doi:10.1007/978-3-031-70371-3_31

BibTeX

@inproceedings{dubowski2024ecmlpkdd-subgroup,
  title     = {{Subgroup Harm Assessor: Identifying Potential Fairness-Related Harms and Predictive Bias}},
  author    = {Dubowski, Adam and Weerts, Hilde J. P. and Wolters, Anouk and Pechenizkiy, Mykola},
  booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
  year      = {2024},
  pages     = {413-417},
  doi       = {10.1007/978-3-031-70371-3_31},
  url       = {https://mlanthology.org/ecmlpkdd/2024/dubowski2024ecmlpkdd-subgroup/}
}