About AMP Lab        Projects        Downloads        Publications        People        Links

Project - Hand Tracking using Spatial Gesture Modeling as Visual Feedback



Team Member

Edward Lin


Top of this page


Motivation and Goal

The ability to accurately track hand movement provides new opportunities for human computer interaction (HCI). Many of today’s commercial hand tracking devices based on gloves can be cumbersome and expensive. An approach that avoids these problems is to use computer vision to capture hand motion. In this project, we present a complete real-time hand tracking and 3-D modeling system based on a single camera. In our system, we extract feature points from a video stream of a hand to control a virtual hand model with 2-D global motion and 3-D local motion. The on screen model gives the user instant feedback on the estimated position of the hand. This visual feedback allows a user to compensate for the errors in tracking. The system is used for three example applications. The first application uses hand tracking and gestures to take on the role of the mouse. The second interacts with a 3D virtual environment using the 3D hand model. The last application is a virtual DJ system that is controlled by hand motion tracking and gestures.

Top of this page


System Description

Top of this page


Conference papers:

  • E. Lin, A. Cassidy, D. Hook, A. Baliga, T. Chen "Hand Tracking using Spatial Gesture Modeling and Visual Feedback for a Virtual DJ System", 4th IEEE International Conference on Multimodal Interfaces (ICMI) 2002 , Rochester, NY, U.S.A., September 2002.

Top of this page

Any suggestions or comments are welcome. Please send them to Edward Lin

Top of this page

This website is maintained by Wende Zhang
Copyright © 200
1 Advanced Multimedia Processing Lab. All rights reserved.
Revised: March 17, 2004 .