Dynamics of Attention as near Saddle-Node Bifurcation Behavior
Abstract
In consideration of attention as a means for goal-directed behav(cid:173) ior in non-stationary environments, we argue that the dynamics of attention should satisfy two opposing demands: long-term main(cid:173) tenance and quick transition. These two characteristics are con(cid:173) tradictory within the linear domain. We propose the near saddle(cid:173) node bifurcation behavior of a sigmoidal unit with self-connection as a candidate of dynamical mechanism that satisfies both of these demands. We further show in simulations of the 'bug-eat-food' tasks that the near saddle-node bifurcation behavior of recurrent networks can emerge as a functional property for survival in non(cid:173) stationary environments.
Cite
Text
Nakahara and Doya. "Dynamics of Attention as near Saddle-Node Bifurcation Behavior." Neural Information Processing Systems, 1995.Markdown
[Nakahara and Doya. "Dynamics of Attention as near Saddle-Node Bifurcation Behavior." Neural Information Processing Systems, 1995.](https://mlanthology.org/neurips/1995/nakahara1995neurips-dynamics/)BibTeX
@inproceedings{nakahara1995neurips-dynamics,
title = {{Dynamics of Attention as near Saddle-Node Bifurcation Behavior}},
author = {Nakahara, Hiroyuki and Doya, Kenji},
booktitle = {Neural Information Processing Systems},
year = {1995},
pages = {38-44},
url = {https://mlanthology.org/neurips/1995/nakahara1995neurips-dynamics/}
}