Event-Driven Dynamic Attention for Multi-Object Tracking on Neuromorphic Hardware
Abstract
We present a real-time, event-driven multi-object tracking system leveraging the SpiNNaker neuromorphic platform and Dynamic Vision Sensor (DVS). Inspired by hippocampal grid neurons, our approach employs a dynamic attention mechanism based on recurrent spiking neural networks (SNNs) for robust tracking in the presence of distractors. Kalman filtering is used for state estimation and motion prediction, while morphological open/close operations enhance object detection. Our system can track objects even as their motion slows or stops, offering scalable and low-power multi-object tracking. We demonstrate its effectiveness in dynamic environments, including swarm robot evasion, highlighting its potential for real-time robotics and autonomous systems.
Cite
Text
Aitsam et al. "Event-Driven Dynamic Attention for Multi-Object Tracking on Neuromorphic Hardware." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2025.Markdown
[Aitsam et al. "Event-Driven Dynamic Attention for Multi-Object Tracking on Neuromorphic Hardware." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2025.](https://mlanthology.org/cvprw/2025/aitsam2025cvprw-eventdriven/)BibTeX
@inproceedings{aitsam2025cvprw-eventdriven,
title = {{Event-Driven Dynamic Attention for Multi-Object Tracking on Neuromorphic Hardware}},
author = {Aitsam, Muhammad and Davies, Sergio and Di Nuovo, Alessandro G.},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
year = {2025},
pages = {5055-5062},
url = {https://mlanthology.org/cvprw/2025/aitsam2025cvprw-eventdriven/}
}