A hand gesture sterile tool for browsing MRI images in the OR. Academic Article uri icon

abstract

  • The use of doctor-computer interaction devices in the operation room (OR) requires new modalities that support medical imaging manipulation while allowing the doctor's hands to remain sterile, supporting his focus of attention, and providing fast response times. This paper presents "Gestix," a vision-based hand gesture capture and recognition system that interprets in real-time the user's gestures for navigation and manipulation of images in an electronic medical record (EMR) database. Navigation and other gestures are translated to commands based on their temporal trajectories, through video capture. "Gestix" was tested during a brain biopsy procedure. In the in vivo experiment, this interface prevented the surgeon's focus shift and change of location while achieving a rapid intuitive reaction, and easy interaction. Data from two usability tests provide insights and implications regarding human-computer interaction based on nonverbal conversational modalities.

publication date

  • May 1, 2008