ML Anthology

Online Analysis of High-Volume Data Streams in Astroparticle Physics

Christian Bockermann, Kai Brügge, Jens Buß, Alexey Egorov, Katharina Morik, Wolfgang Rhode, Tim Ruhe
ECML-PKDD 2015 pp. 100-115
doi:10.1007/978-3-319-23461-8_7 /ecmlpkdd/2015/bockermann2015ecmlpkdd-online/

Abstract

Experiments in high-energy astroparticle physics produce large amounts of data as continuous high-volume streams. Gaining insights from the observed data poses a number of challenges to data analysis at various steps in the analysis chain of the experiments. Machine learning methods have already cleaved their way selectively at some particular stages of the overall data mangling process. In this paper we investigate the deployment of machine learning methods at various stages of the data analysis chain in a gamma-ray astronomy experiment. Aiming at online and real-time performance, we build up on prominent software libraries and discuss the complete cycle of data processing from raw-data capturing to high-level classification using a data-flow based rapid-prototyping environment. In the context of a gamma-ray experiment, we review user requirements in this interdisciplinary setting and demonstrate the applicability of our approach in a real-world setting to provide results from high-volume data streams in real-time performance.

PDF ECML-PKDD Semantic Scholar

Cite

Text

Bockermann et al. "Online Analysis of High-Volume Data Streams in Astroparticle Physics." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2015. doi:10.1007/978-3-319-23461-8_7

Markdown

[Bockermann et al. "Online Analysis of High-Volume Data Streams in Astroparticle Physics." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2015.](https://mlanthology.org/ecmlpkdd/2015/bockermann2015ecmlpkdd-online/) doi:10.1007/978-3-319-23461-8_7

BibTeX

@inproceedings{bockermann2015ecmlpkdd-online,
  title     = {{Online Analysis of High-Volume Data Streams in Astroparticle Physics}},
  author    = {Bockermann, Christian and Brügge, Kai and Buß, Jens and Egorov, Alexey and Morik, Katharina and Rhode, Wolfgang and Ruhe, Tim},
  booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
  year      = {2015},
  pages     = {100-115},
  doi       = {10.1007/978-3-319-23461-8_7},
  url       = {https://mlanthology.org/ecmlpkdd/2015/bockermann2015ecmlpkdd-online/}
}