Efficiently Monitoring Small Data Modification Effect for Large-Scale Learning in Changing Environment

Abstract

We study large-scale machine learning problems in changing environments where a small part of the dataset is modified, and the effect of the data modification must be monitored in order to know how much the modification changes the optimal model. When the entire dataset is large, even if the amount of the data modification is fairly small, the computational cost for re-training the model would be prohibitively large. In this paper, we propose a novel method, called the optimal solution bounding (OSB), for monitoring such a data modification effect on the optimal model by efficiently evaluating (without actually re-training) it. The proposed method provides bounds on the unknown optimal model with the cost proportional only to the size of the data modification.

Cite

Text

Hanada et al. "Efficiently Monitoring Small Data Modification Effect for Large-Scale Learning in Changing Environment." AAAI Conference on Artificial Intelligence, 2018. doi:10.1609/AAAI.V32I1.11516

Markdown

[Hanada et al. "Efficiently Monitoring Small Data Modification Effect for Large-Scale Learning in Changing Environment." AAAI Conference on Artificial Intelligence, 2018.](https://mlanthology.org/aaai/2018/hanada2018aaai-efficiently/) doi:10.1609/AAAI.V32I1.11516

BibTeX

@inproceedings{hanada2018aaai-efficiently,
  title     = {{Efficiently Monitoring Small Data Modification Effect for Large-Scale Learning in Changing Environment}},
  author    = {Hanada, Hiroyuki and Shibagaki, Atsushi and Sakuma, Jun and Takeuchi, Ichiro},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2018},
  pages     = {1314-1321},
  doi       = {10.1609/AAAI.V32I1.11516},
  url       = {https://mlanthology.org/aaai/2018/hanada2018aaai-efficiently/}
}