ML Anthology

Learning Latent Temporal Connectionism of Deep Residual Visual Abstractions for Identifying Surgical Tools in Laparoscopy Procedures

Kaustuv Mishra, Rachana Sathish, Debdoot Sheet
CVPRW 2017 pp. 2233-2240
doi:10.1109/CVPRW.2017.277 /cvprw/2017/mishra2017cvprw-learning/

Abstract

Surgical workflow in minimally invasive interventions like laparoscopy can be modeled with the aid of tool usage information. The video stream available during surgery primarily for viewing the surgical site using an endoscope can be leveraged for this purpose without the need for additional sensors or instruments. We propose a method which learns to detect the tool presence in laparoscopy videos by leveraging the temporal connectionist information in a systematically executed surgical procedures by learning the long and short order relationships between higher abstractions of the spatial visual features extracted from the surgical video. We propose a framework consisting of using Convolutional Neural Networks for extracting the visual features and Long Short-Term Memory network to encode the temporal information. The proposed framework has been experimentally verified using a publicly available dataset consisting of 10 training and 5 testing annotated videos to obtain an average accuracy of 88:75% in detecting the tools present.

CVPRW Semantic Scholar

Cite

Text

Mishra et al. "Learning Latent Temporal Connectionism of Deep Residual Visual Abstractions for Identifying Surgical Tools in Laparoscopy Procedures." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2017. doi:10.1109/CVPRW.2017.277

Markdown

[Mishra et al. "Learning Latent Temporal Connectionism of Deep Residual Visual Abstractions for Identifying Surgical Tools in Laparoscopy Procedures." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2017.](https://mlanthology.org/cvprw/2017/mishra2017cvprw-learning/) doi:10.1109/CVPRW.2017.277

BibTeX

@inproceedings{mishra2017cvprw-learning,
  title     = {{Learning Latent Temporal Connectionism of Deep Residual Visual Abstractions for Identifying Surgical Tools in Laparoscopy Procedures}},
  author    = {Mishra, Kaustuv and Sathish, Rachana and Sheet, Debdoot},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2017},
  pages     = {2233-2240},
  doi       = {10.1109/CVPRW.2017.277},
  url       = {https://mlanthology.org/cvprw/2017/mishra2017cvprw-learning/}
}