Label-Free Supervision of Neural Networks with Physics and Domain Knowledge
Abstract
In many machine learning applications, labeled data is scarce and obtaining more labels is expensive. We introduce a new approach to supervising neural networks by specifying constraints that should hold over the output space, rather than direct examples of input-output pairs. These constraints are derived from prior domain knowledge, e.g., from known laws of physics. We demonstrate the effectiveness of this approach on real world and simulated computer vision tasks. We are able to train a convolutional neural network to detect and track objects without any labeled examples. Our approach can significantly reduce the need for labeled training data, but introduces new challenges for encoding prior knowledge into appropriate loss functions.
Cite
Text
Stewart and Ermon. "Label-Free Supervision of Neural Networks with Physics and Domain Knowledge." AAAI Conference on Artificial Intelligence, 2017. doi:10.1609/AAAI.V31I1.10934Markdown
[Stewart and Ermon. "Label-Free Supervision of Neural Networks with Physics and Domain Knowledge." AAAI Conference on Artificial Intelligence, 2017.](https://mlanthology.org/aaai/2017/stewart2017aaai-label/) doi:10.1609/AAAI.V31I1.10934BibTeX
@inproceedings{stewart2017aaai-label,
title = {{Label-Free Supervision of Neural Networks with Physics and Domain Knowledge}},
author = {Stewart, Russell and Ermon, Stefano},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {2017},
pages = {2576-2582},
doi = {10.1609/AAAI.V31I1.10934},
url = {https://mlanthology.org/aaai/2017/stewart2017aaai-label/}
}