ML Anthology

OpenVINO Deep Learning Workbench: Comprehensive Analysis and Tuning of Neural Networks Inference

Yury Gorbachev, Mikhail Fedorov, Iliya Slavutin, Artyom Tugarev, Marat Fatekhov, Yaroslav Tarkan
ICCVW 2019 pp. 783-787
doi:10.1109/ICCVW.2019.00104 /iccvw/2019/gorbachev2019iccvw-openvino/

Abstract

A task of maximizing deep learning neural networks performance is a challenging and actual goal of modern hardware and software development. Regardless the huge variety of optimization techniques and emerging dedicated hardware platforms, the process of tuning the performance of the neural network is hard. It requires configuring dozens of hyper parameters of optimization algorithms, selecting appropriate metrics, benchmarking the intermediate solutions to choose the best method, platform etc. Moreover, it is required to setup the hardware for the specific inference target. This paper introduces a sophisticated software solution (Deep Learning Workbench) that provides interactive user interface, simplified process of 8-bit quantization, speeding up convolutional operations using the Winograds minimal filtering algorithms, measuring accuracy of the resulting model. The proposed software is built over the open source OpenVINO framework and supports huge range of modern deep learning models.

ICCVW Semantic Scholar

Cite

Text

Gorbachev et al. "OpenVINO Deep Learning Workbench: Comprehensive Analysis and Tuning of Neural Networks Inference." IEEE/CVF International Conference on Computer Vision Workshops, 2019. doi:10.1109/ICCVW.2019.00104

Markdown

[Gorbachev et al. "OpenVINO Deep Learning Workbench: Comprehensive Analysis and Tuning of Neural Networks Inference." IEEE/CVF International Conference on Computer Vision Workshops, 2019.](https://mlanthology.org/iccvw/2019/gorbachev2019iccvw-openvino/) doi:10.1109/ICCVW.2019.00104

BibTeX

@inproceedings{gorbachev2019iccvw-openvino,
  title     = {{OpenVINO Deep Learning Workbench: Comprehensive Analysis and Tuning of Neural Networks Inference}},
  author    = {Gorbachev, Yury and Fedorov, Mikhail and Slavutin, Iliya and Tugarev, Artyom and Fatekhov, Marat and Tarkan, Yaroslav},
  booktitle = {IEEE/CVF International Conference on Computer Vision Workshops},
  year      = {2019},
  pages     = {783-787},
  doi       = {10.1109/ICCVW.2019.00104},
  url       = {https://mlanthology.org/iccvw/2019/gorbachev2019iccvw-openvino/}
}