Hand Movement Recognition by Using a Touchless Sensor for Controlling Images in Operating Room

Abstract

To operate under sterilization condition in operating room help to reduce infection rate in patient. Therefore, surgeons cannot control computer by using mouse, or keyboard. In this paper, we proposed a method to controlling images in operating room by using a touchless sensor. This method consists of four step. First, hand motion is sensed by a touchless sensor as Leap motion. Second, hand position is detected. Third, hand gesture is recognized by using movement direction. Finally, image is shown and processed relating with hand gesture command. To test the performance of the proposed method, twenty subjects used this device to control an images. This method controls images with two gestures and eight commands: waiting, selection, searching left image, searching right image, increasing brightness, reducing brightness, zooming in and out, and left or right rotation commends. Accuracy rate of commands interpretation is 87.67%. The performance of the proposed method is effective for real-world applications. This is an alternative method for controlling image in an operation room. © 2018 IEEE.