Adaptive Estimation of the Optimal ROC Curve and a Bipartite Ranking Algorithm

Abstract

In this paper, we propose an adaptive algorithm for bipartite ranking and prove its statistical performance in a stronger sense than the AUC criterion. Our procedure builds on and significantly improves the RankOver algorithm proposed in [1]. The algorithm outputs a piecewise constant scoring rule which is obtained by overlaying a finite collection of classifiers. Here, each of these classifiers is the empirical solution of a specific minimum-volume set (MV-set) estimation problem. The major novelty arises from the fact that the levels of the MV-sets to recover are chosen adaptively from the data to adjust to the variability of the target curve. The ROC curve of the estimated scoring rule may be interpreted as an adaptive spline approximant of the optimal ROC curve. Error bounds for the estimate of the optimal ROC curve in terms of the L _ ∞ -distance are also provided.

Cite

Text

Clémençon and Vayatis. "Adaptive Estimation of the Optimal ROC Curve and a Bipartite Ranking Algorithm." International Conference on Algorithmic Learning Theory, 2009. doi:10.1007/978-3-642-04414-4_20

Markdown

[Clémençon and Vayatis. "Adaptive Estimation of the Optimal ROC Curve and a Bipartite Ranking Algorithm." International Conference on Algorithmic Learning Theory, 2009.](https://mlanthology.org/alt/2009/clemencon2009alt-adaptive/) doi:10.1007/978-3-642-04414-4_20

BibTeX

@inproceedings{clemencon2009alt-adaptive,
  title     = {{Adaptive Estimation of the Optimal ROC Curve and a Bipartite Ranking Algorithm}},
  author    = {Clémençon, Stéphan and Vayatis, Nicolas},
  booktitle = {International Conference on Algorithmic Learning Theory},
  year      = {2009},
  pages     = {216-231},
  doi       = {10.1007/978-3-642-04414-4_20},
  url       = {https://mlanthology.org/alt/2009/clemencon2009alt-adaptive/}
}