Motion-Aware Heatmap Regression for Human Pose Estimation in Videos

Abstract

Point cloud completion is a crucial task in 3D computer vision. Multi-modal completion approaches have gained attention among the popular two-stage point cloud completion methods. However, there is a notable lack of research focused on accurately aligning data from different modalities within these methods. Additionally, in other point cloud-based tasks, edge point information often provides unexpected positive contributions. In this paper, we propose a novel point cloud completion method that leverages edge point information for the first time in the completion task, which also addresses the precise alignment of multi-modal data. In particular, we implement a two-step local-to-global module to achieve better alignment of multi-modal data during the preliminary point cloud generation process. Besides, we introduce a new spatial representation structure capable of extracting a fixed number of edge points. Moreover, with the assistance of edge information, we further design an inverse edge-aware upsampler to refine the point cloud. We evaluate our method on three typical datasets, and the results demonstrate that our IE-PMMA outperforms the existing state-of-the-art methods quantitatively and visually.

Cite

Text

Song et al. "Motion-Aware Heatmap Regression for Human Pose Estimation in Videos." International Joint Conference on Artificial Intelligence, 2024. doi:10.24963/ijcai.2024/138

Markdown

[Song et al. "Motion-Aware Heatmap Regression for Human Pose Estimation in Videos." International Joint Conference on Artificial Intelligence, 2024.](https://mlanthology.org/ijcai/2024/song2024ijcai-motion/) doi:10.24963/ijcai.2024/138

BibTeX

@inproceedings{song2024ijcai-motion,
  title     = {{Motion-Aware Heatmap Regression for Human Pose Estimation in Videos}},
  author    = {Song, Inpyo and Lee, Jongmin and Ryu, Moonwook and Lee, Jangwon},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2024},
  pages     = {1245-1253},
  doi       = {10.24963/ijcai.2024/138},
  url       = {https://mlanthology.org/ijcai/2024/song2024ijcai-motion/}
}