Deep Network Classification by Scattering and Homotopy Dictionary Learning
Abstract
We introduce a sparse scattering deep convolutional neural network, which provides a simple model to analyze properties of deep representation learning for classification. Learning a single dictionary matrix with a classifier yields a higher classification accuracy than AlexNet over the ImageNet 2012 dataset. The network first applies a scattering transform that linearizes variabilities due to geometric transformations such as translations and small deformations. A sparse $\ell^1$ dictionary coding reduces intra-class variability while preserving class separation through projections over unions of linear spaces. It is implemented in a deep convolutional network with a homotopy algorithm having an exponential convergence. A convergence proof is given in a general framework that includes ALISTA. Classification results are analyzed on ImageNet.
Cite
Text
Zarka et al. "Deep Network Classification by Scattering and Homotopy Dictionary Learning." International Conference on Learning Representations, 2020.Markdown
[Zarka et al. "Deep Network Classification by Scattering and Homotopy Dictionary Learning." International Conference on Learning Representations, 2020.](https://mlanthology.org/iclr/2020/zarka2020iclr-deep/)BibTeX
@inproceedings{zarka2020iclr-deep,
title = {{Deep Network Classification by Scattering and Homotopy Dictionary Learning}},
author = {Zarka, John and Thiry, Louis and Angles, Tomás and Mallat, Stéphane},
booktitle = {International Conference on Learning Representations},
year = {2020},
url = {https://mlanthology.org/iclr/2020/zarka2020iclr-deep/}
}