Long-Term Image Boundary Prediction

Abstract

Boundary estimation in images and videos has been a very active topic of research, and organizing visual information into boundaries and segments is believed to be a corner stone of visual perception. While prior work has focused on estimating boundaries for observed frames, our work aims at predicting boundaries of future unobserved frames. This requires our model to learn about the fate of boundaries and corresponding motion patterns---including a notion of "intuitive physics." We experiment on natural video sequences along with synthetic sequences with deterministic physics-based and agent-based motions. While not being our primary goal, we also show that fusion of RGB and boundary prediction leads to improved RGB predictions.

Cite

Text

Bhattacharyya et al. "Long-Term Image Boundary Prediction." AAAI Conference on Artificial Intelligence, 2018. doi:10.1609/AAAI.V32I1.11811

Markdown

[Bhattacharyya et al. "Long-Term Image Boundary Prediction." AAAI Conference on Artificial Intelligence, 2018.](https://mlanthology.org/aaai/2018/bhattacharyya2018aaai-long/) doi:10.1609/AAAI.V32I1.11811

BibTeX

@inproceedings{bhattacharyya2018aaai-long,
  title     = {{Long-Term Image Boundary Prediction}},
  author    = {Bhattacharyya, Apratim and Malinowski, Mateusz and Schiele, Bernt and Fritz, Mario},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2018},
  pages     = {2720-2729},
  doi       = {10.1609/AAAI.V32I1.11811},
  url       = {https://mlanthology.org/aaai/2018/bhattacharyya2018aaai-long/}
}