Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces
Abstract
Olshausen and Field (1996) applied the principle of independence maximization by sparse coding to extract features from natural images. This leads to the emergence of oriented linear filters that have simultaneous localization in space and in frequency, thus resembling Gabor functions and simple cell receptive fields. In this article, we show that the same principle of independence maximization can explain the emergence of phase- and shift-invariant features, similar to those found in complex cells. This new kind of emergence is obtained by maximizing the independence between norms of projections on linear subspaces (instead of the independence of simple linear filter outputs). The norms of the projections on such “independent feature subspaces” then indicate the values of invariant features.
Cite
Text
Hyvärinen and Hoyer. "Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces." Neural Computation, 2000. doi:10.1162/089976600300015312Markdown
[Hyvärinen and Hoyer. "Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces." Neural Computation, 2000.](https://mlanthology.org/neco/2000/hyvarinen2000neco-emergence/) doi:10.1162/089976600300015312BibTeX
@article{hyvarinen2000neco-emergence,
title = {{Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces}},
author = {Hyvärinen, Aapo and Hoyer, Patrik O.},
journal = {Neural Computation},
year = {2000},
pages = {1705-1720},
doi = {10.1162/089976600300015312},
volume = {12},
url = {https://mlanthology.org/neco/2000/hyvarinen2000neco-emergence/}
}