Generalization Bounds for Weighted Binary Classification with Applications to Statistical Verification
Abstract
We describe an approach to statistically verifying complex controllers. This approach is based on deriving practical Vapnik-Chervonenkis-style (VC) generalization bounds for binary classifiers with weighted loss. An important case is deriving bounds on the probability of false positive. We show how existing methods to derive bounds on classification error can be extended to derive similar bounds on the probability of false positive, as well as bounds in a decision-theoretic setting that allows tradeoffs between false negatives and false positives. We describe experiments using these bounds in statistically verifying computational properties of an iterative controller for an Organic Air Vehicle (OAV).
Cite
Text
Ha and Samad. "Generalization Bounds for Weighted Binary Classification with Applications to Statistical Verification." International Joint Conference on Artificial Intelligence, 2005.Markdown
[Ha and Samad. "Generalization Bounds for Weighted Binary Classification with Applications to Statistical Verification." International Joint Conference on Artificial Intelligence, 2005.](https://mlanthology.org/ijcai/2005/ha2005ijcai-generalization/)BibTeX
@inproceedings{ha2005ijcai-generalization,
title = {{Generalization Bounds for Weighted Binary Classification with Applications to Statistical Verification}},
author = {Ha, Vu and Samad, Tariq},
booktitle = {International Joint Conference on Artificial Intelligence},
year = {2005},
pages = {722-727},
url = {https://mlanthology.org/ijcai/2005/ha2005ijcai-generalization/}
}