Discovering Wiring Patterns Influencing Neural Network Performance
Abstract
The search for optimal neural network architecture is a well-known problem in deep learning. However, as many algorithms have been proposed in this domain, little attention is given to the analysis of wiring properties that are beneficial or detrimental to the network performance. We take a step at addressing this issue by performing a massive evaluation of artificial neural networks with various computational architectures, where the diversity of the studied constructions is obtained by basing the wiring topology of the networks on different types of random graphs. Our goal is to investigate the structural and numerical properties of the graphs and assess their relation to the test accuracy of the corresponding neural networks. We find that none of the classical numerical graph invariants by itself allows to single out the best networks. Consequently, we introduce a new numerical graph characteristic, called quasi-1-dimensionality , which is able to identify the majority of the best-performing graphs.
Cite
Text
Nowak and Janik. "Discovering Wiring Patterns Influencing Neural Network Performance." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2022. doi:10.1007/978-3-031-26409-2_38Markdown
[Nowak and Janik. "Discovering Wiring Patterns Influencing Neural Network Performance." European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2022.](https://mlanthology.org/ecmlpkdd/2022/nowak2022ecmlpkdd-discovering/) doi:10.1007/978-3-031-26409-2_38BibTeX
@inproceedings{nowak2022ecmlpkdd-discovering,
title = {{Discovering Wiring Patterns Influencing Neural Network Performance}},
author = {Nowak, Aleksandra and Janik, Romuald A.},
booktitle = {European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases},
year = {2022},
pages = {631-646},
doi = {10.1007/978-3-031-26409-2_38},
url = {https://mlanthology.org/ecmlpkdd/2022/nowak2022ecmlpkdd-discovering/}
}