Training Compact Deep Learning Models for Video Classification Using Circulant Matrices
Abstract
In real world scenarios, model accuracy is hardly the only factor to consider. Large models consume more memory and are computationally more intensive, which make them difficult to train and to deploy, especially on mobile devices. In this paper, we build on recent results at the crossroads of Linear Algebra and Deep Learning which demonstrate how imposing a structure on large weight matrices can be used to reduce the size of the model. Building on these results, we propose very compact models for video classification based on state-of-the-art network architectures such as Deep Bag-of-Frames, NetVLAD and NetFisherVectors. We then conduct thorough experiments using the large YouTube-8M video classification dataset. As we will show, the circulant DBoF embedding achieves an excellent trade-off between size and accuracy.
Cite
Text
Araujo et al. "Training Compact Deep Learning Models for Video Classification Using Circulant Matrices." European Conference on Computer Vision Workshops, 2018. doi:10.1007/978-3-030-11018-5_25Markdown
[Araujo et al. "Training Compact Deep Learning Models for Video Classification Using Circulant Matrices." European Conference on Computer Vision Workshops, 2018.](https://mlanthology.org/eccvw/2018/araujo2018eccvw-training/) doi:10.1007/978-3-030-11018-5_25BibTeX
@inproceedings{araujo2018eccvw-training,
title = {{Training Compact Deep Learning Models for Video Classification Using Circulant Matrices}},
author = {Araujo, Alexandre and Négrevergne, Benjamin and Chevaleyre, Yann and Atif, Jamal},
booktitle = {European Conference on Computer Vision Workshops},
year = {2018},
pages = {271-286},
doi = {10.1007/978-3-030-11018-5_25},
url = {https://mlanthology.org/eccvw/2018/araujo2018eccvw-training/}
}