A Method of 3D Hand Movement Recognition by a Leap Motion Sensor for Controlling Medical Image in an Operating Room

Abstract

A problem of surgery is an infection of patient. In this paper, we presented a method to control medical image in an operating room by using only a hand. The proposed methods consisted of five steps, namely 1) data acquisition from Leap Motion sensor 2) hand visualization with color mapping 3) close and open hand classification 4) hand gesture recognition and 5) command interpretation. The system has total ten commands divided to six commands on program screen, namely, waiting, selection, searching next image in left and right direction, and increasing and decreasing brightness, and four commands on button; namely, zoom in, zoom out, clockwise rotation, and counterclockwise rotation. An accuracy rate average is 95.83%. The results show that the proposed method performs effectively. The advantage of the proposed method is one hand can control the image. © 2019 IEEE.