Space-Time Video Completion
Abstract
We present a method for space-time completion of large space-time "holes" in video sequences of complex dynamic scenes. The missing portions are filled-in by sampling spatio-temporal patches from the available parts of the video, while enforcing global spatio-temporal consistency between all patches in and around the hole. This is obtained by posing the task of video completion and synthesis as a global optimization problem with a well-defined objective function. The consistent completion of static scene parts simultaneously with dynamic behaviors leads to realistic looking video sequences. Space-time video completion is useful for a variety of tasks, including, but not limited to: (i) Sophisticated video removal (of undesired static or dynamic objects) by completing the appropriate static or dynamic background information, (ii) Correction of missing/corrupted video frames in old movies, and (iii) Synthesis of new video frames to add a visual story, modify it, or generate a new one. Some examples of these are shown in the paper.
Cite
Text
Wexler et al. "Space-Time Video Completion." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2004. doi:10.1109/CVPR.2004.237Markdown
[Wexler et al. "Space-Time Video Completion." IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2004.](https://mlanthology.org/cvpr/2004/wexler2004cvpr-space/) doi:10.1109/CVPR.2004.237BibTeX
@inproceedings{wexler2004cvpr-space,
title = {{Space-Time Video Completion}},
author = {Wexler, Yonatan and Shechtman, Eli and Irani, Michal},
booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
year = {2004},
pages = {120-127},
doi = {10.1109/CVPR.2004.237},
url = {https://mlanthology.org/cvpr/2004/wexler2004cvpr-space/}
}