Instrument State Recognition and Tracking for Effective Control of Robotized Laparoscopic Systems

  • Surgical robots are an important component for delivering advanced paradigm shifting technology such as image guided surgery and navigation. However, for robotic systems to be readily adopted into the operating room they must be easy and convenient to control and facilitate a smooth surgical workflow. In minimally invasive surgery, the laparoscope may be held by a robot but controlling and moving the laparoscope remains challenging. It is disruptive to the workflow for the surgeon to put down the tools to move the robot in particular for solo surgery approaches. This paper proposes a novel approach for naturally controlling the robot mounted laparoscope’s position by detecting a surgical grasping tool and recognizing if its state is open or close. This approach does not require markers or fiducials and uses a machine learning framework for tool and state recognition which exploits naturally occurring visual cues. Furthermore a virtual user interface on the laparoscopic image is proposed that uses the surgical tool as a pointing device to overcome common problems in depth perception. Instrument detection and state recognition are evaluated on in-vivo and ex-vivo porcine datasets. To demonstrate the practical surgical application and real time performance the system is validated in a simulated surgical environment.

Export metadata

  • Export Bibtex
Metadaten
Author:Manish Sahu, Daniil Moerman, Philip Mewes, Peter Mountney, Georg Rose
Document Type:Article
Parent Title (English):International Journal of Mechanical Engineering and Robotics Research
Volume:5
Issue:1
First Page:33
Last Page:38
Year of first publication:2016
DOI:http://dx.doi.org/10.18178/ijmerr.5.1.33-38

$Rev: 13581 $