ML Anthology

Real-Time Hand Grasp Recognition Using Weakly Supervised Two-Stage Convolutional Neural Networks for Understanding Manipulation Actions

Ji Woong Kim, Sujeong You, Sang Hoon Ji, Hong Seok Kim
CVPRW 2017 pp. 481-483
doi:10.1109/CVPRW.2017.67 /cvprw/2017/kim2017cvprw-realtime/

Abstract

Understanding human hand usage is one of the richest information source to recognize human manipulation actions. Since humans use various tools during actions, grasp recognition gives important cues to figure out humans' intention and tasks. Earlier studies analyzed grasps with positions of hand joints by attaching sensors, but since these types of sensors prevent humans from naturally conducting actions, visual approaches have been focused in recent years. Convolutional neural networks require a vast annotated dataset, but, to our knowledge, no human grasping dataset includes ground truth of hand regions. In this paper, we propose a grasp recognition method only with image-level labels by the weakly supervised learning framework. In addition, we split the grasp recognition process into two stages that are hand localization and grasp classification so as to speed up. Experimental results demonstrate that the proposed method outperforms existing methods and can perform in real-time.

CVPRW Semantic Scholar

Cite

Text

Kim et al. "Real-Time Hand Grasp Recognition Using Weakly Supervised Two-Stage Convolutional Neural Networks for Understanding Manipulation Actions." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2017. doi:10.1109/CVPRW.2017.67

Markdown

[Kim et al. "Real-Time Hand Grasp Recognition Using Weakly Supervised Two-Stage Convolutional Neural Networks for Understanding Manipulation Actions." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2017.](https://mlanthology.org/cvprw/2017/kim2017cvprw-realtime/) doi:10.1109/CVPRW.2017.67

BibTeX

@inproceedings{kim2017cvprw-realtime,
  title     = {{Real-Time Hand Grasp Recognition Using Weakly Supervised Two-Stage Convolutional Neural Networks for Understanding Manipulation Actions}},
  author    = {Kim, Ji Woong and You, Sujeong and Ji, Sang Hoon and Kim, Hong Seok},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2017},
  pages     = {481-483},
  doi       = {10.1109/CVPRW.2017.67},
  url       = {https://mlanthology.org/cvprw/2017/kim2017cvprw-realtime/}
}