Enhancing Unit-Tests for Invariance Discovery
Abstract
Recently, Aubin et al. (2021) proposed a set of linear low-dimensional problems to precisely evaluate different types of out-of-distribution generalization. In this paper, we show that one of these problems can already be solved by established algorithms, simply by better hyper-parameter tuning. We then propose an enhanced version of the linear unit-tests. To the best of our hyper-parameter search and within the set of algorithms evaluated, AND-mask is the best performing algorithm on this new suite of tests. Our findings on synthetic data are further reinforced by experiments on an image classification task where we introduce spurious correlations.
Cite
Text
De Bartolomeis et al. "Enhancing Unit-Tests for Invariance Discovery." ICML 2022 Workshops: SCIS, 2022.Markdown
[De Bartolomeis et al. "Enhancing Unit-Tests for Invariance Discovery." ICML 2022 Workshops: SCIS, 2022.](https://mlanthology.org/icmlw/2022/bartolomeis2022icmlw-enhancing/)BibTeX
@inproceedings{bartolomeis2022icmlw-enhancing,
title = {{Enhancing Unit-Tests for Invariance Discovery}},
author = {De Bartolomeis, Piersilvio and Orvieto, Antonio and Parascandolo, Giambattista},
booktitle = {ICML 2022 Workshops: SCIS},
year = {2022},
url = {https://mlanthology.org/icmlw/2022/bartolomeis2022icmlw-enhancing/}
}