Consistency of Losses for Learning from Weak Labels
Abstract
In this paper we analyze the consistency of loss functions for learning from weakly labelled data, and its relation to properness. We show that the consistency of a given loss depends on the mixing matrix, which is the transition matrix relating the weak labels and the true class. A linear transformation can be used to convert a conventional classification-calibrated (CC) loss into a weak CC loss. By comparing the maximal dimension of the set of mixing matrices that are admissible for a given CC loss with that for proper losses, we show that classification calibration is a much less restrictive condition than properness. Moreover, we show that while the transformation of conventional proper losses into a weak proper losses does not preserve convexity in general, conventional convex CC losses can be easily transformed into weak and convex CC losses. Our analysis provides a general procedure to construct convex CC losses, and to identify the set of mixing matrices admissible for a given transformation. Several examples are provided to illustrate our approach.
Cite
Text
Cid-Sueiro et al. "Consistency of Losses for Learning from Weak Labels." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2014. doi:10.1007/978-3-662-44848-9_13Markdown
[Cid-Sueiro et al. "Consistency of Losses for Learning from Weak Labels." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2014.](https://mlanthology.org/ecmlpkdd/2014/cidsueiro2014ecmlpkdd-consistency/) doi:10.1007/978-3-662-44848-9_13BibTeX
@inproceedings{cidsueiro2014ecmlpkdd-consistency,
title = {{Consistency of Losses for Learning from Weak Labels}},
author = {Cid-Sueiro, Jesús and García-García, Dario and Santos-Rodríguez, Raúl},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2014},
pages = {197-210},
doi = {10.1007/978-3-662-44848-9_13},
url = {https://mlanthology.org/ecmlpkdd/2014/cidsueiro2014ecmlpkdd-consistency/}
}