Hyper-Parameter Optimization for Latent Spaces
Abstract
We present an online optimization method for time-evolving data streams that can automatically adapt the hyper-parameters of an embedding model. More specifically, we employ the Nelder-Mead algorithm, which uses a set of heuristics to produce and exploit several potentially good configurations, from which the best one is selected and deployed. This step is repeated whenever the distribution of the data is changing. We evaluate our approach on streams of real-world as well as synthetic data, where the latter is generated in such way that its characteristics change over time (concept drift). Overall, we achieve good performance in terms of accuracy compared to state-of-the-art AutoML techniques.
Cite
Text
Veloso et al. "Hyper-Parameter Optimization for Latent Spaces." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2021. doi:10.1007/978-3-030-86523-8_16Markdown
[Veloso et al. "Hyper-Parameter Optimization for Latent Spaces." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2021.](https://mlanthology.org/ecmlpkdd/2021/veloso2021ecmlpkdd-hyperparameter/) doi:10.1007/978-3-030-86523-8_16BibTeX
@inproceedings{veloso2021ecmlpkdd-hyperparameter,
title = {{Hyper-Parameter Optimization for Latent Spaces}},
author = {Veloso, Bruno and Caroprese, Luciano and König, Matthias and Teixeira, Sónia and Manco, Giuseppe and Hoos, Holger H. and Gama, João},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2021},
pages = {249-264},
doi = {10.1007/978-3-030-86523-8_16},
url = {https://mlanthology.org/ecmlpkdd/2021/veloso2021ecmlpkdd-hyperparameter/}
}