Online Video Registration of Dynamic Scenes Using Frame Prediction
Abstract
An online approach is proposed for Video registration of dynamic scenes, such as scenes with dynamic textures, moving objects, motion parallax, etc. This approach has three steps: (i) Assume that a few frames are already registered. (ii) Using the registered frames, the next frame is predicted. (iii) A new video frame is registered to the predicted frame. Frame prediction overcomes the bias introduced by dynamics in the scene, even when dynamic objects cover the majority of the image. It can also overcome many systematic changes in intensity, and the “brightness constancy” is replaced with “dynamic constancy”. This predictive online approach can also be used with motion parallax, where non uniform image motion is caused by camera translation in a 3D scene with large depth variations. In this case a method to compute the camera ego motion is described.
Cite
Text
Rav-Acha et al. "Online Video Registration of Dynamic Scenes Using Frame Prediction." European Conference on Computer Vision, 2006. doi:10.1007/978-3-540-70932-9_12Markdown
[Rav-Acha et al. "Online Video Registration of Dynamic Scenes Using Frame Prediction." European Conference on Computer Vision, 2006.](https://mlanthology.org/eccv/2006/ravacha2006eccv-online/) doi:10.1007/978-3-540-70932-9_12BibTeX
@inproceedings{ravacha2006eccv-online,
title = {{Online Video Registration of Dynamic Scenes Using Frame Prediction}},
author = {Rav-Acha, Alex and Pritch, Yael and Peleg, Shmuel},
booktitle = {European Conference on Computer Vision},
year = {2006},
pages = {151-164},
doi = {10.1007/978-3-540-70932-9_12},
url = {https://mlanthology.org/eccv/2006/ravacha2006eccv-online/}
}