Hardware-Aware NAS by Genetic Optimisation with a Design Space Exploration Simulator
Abstract
Neural Architecture Search (NAS) has shown its potential in aiding in the development of more efficient neural networks. In regard to hardware, efficiency often equates to power usage or latency. Over the years many researchers have incorporated hardware performance into their NAS experiments. However, accurately modelling hardware performance is a challenge in itself. We look to the field of design space exploration (DSE) for more precise performance metrics on neural network accelerators and incorporate the results into our NAS search. Our experiments show that doing so achieves a significant reduction in latency and energy consumption. The approach we propose also enables detailed insight in the breakdown of the energy consumption and latency of the optimised model.
Cite
Text
Hendrickx et al. "Hardware-Aware NAS by Genetic Optimisation with a Design Space Exploration Simulator." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2023. doi:10.1109/CVPRW59228.2023.00222Markdown
[Hendrickx et al. "Hardware-Aware NAS by Genetic Optimisation with a Design Space Exploration Simulator." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2023.](https://mlanthology.org/cvprw/2023/hendrickx2023cvprw-hardwareaware/) doi:10.1109/CVPRW59228.2023.00222BibTeX
@inproceedings{hendrickx2023cvprw-hardwareaware,
title = {{Hardware-Aware NAS by Genetic Optimisation with a Design Space Exploration Simulator}},
author = {Hendrickx, Lotte and Symons, Arne and Van Ranst, Wiebe and Verhelst, Marian and Goedemé, Toon},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
year = {2023},
pages = {2275-2283},
doi = {10.1109/CVPRW59228.2023.00222},
url = {https://mlanthology.org/cvprw/2023/hendrickx2023cvprw-hardwareaware/}
}