Doctor-Computer Interface using Gestures Academic Article uri icon


  • The motivation of this system is the sterile control for the interaction between doctors/surgeons and medical imaging systems. A web-camera placed above a screen (Fig. 1) captures a sequence of images of the hand. The hand is tracked by a tracking module which segments the hand from the background using color and motion cues. This is followed by black/white thresholding and various morphological image processing operations. The location of the hand in each image is represented by the 2D coordinates of its centroid. The system is implemented through a two level architecture. The lower level, named Gestix, provides tracking and recognition functions, while the higher level, named Gibson, manages the user interface.(a)(b)

publication date

  • January 1, 2007