Synopsis

SYNOPSIS

Title: Vision Based Hand Gesture Recognition For Intelligent Human Computer Interaction.

Goal: To develop a tool which uses real time hand tracking for interacting with computer.

Introduction:

A Hand gesture is defined as a dynamic movement,such as waving “good bye..”.Gestures are made in 2 ways. First,a simple posture of hand and change in the position or orientation of the hand. Second,Position and orientation is not changed ,But moving fingers in some way. Some complex gestures may include both of the above.

First step is to collect the raw data. And this raw data is analyzed by different algorithms to find out some pattern out of it and further it is used in hand gesture recognition. We use cameras to collect raw data.

Once the raw data has been collected it must be analysed to determine if there are any gestures recognized. There are several algorithms available.

Approach:-

Hidden Markov Models:

HMM is defined as a set of states of which one state is starting state , a set of output states and some state transitions. Each state transition is represented by state from which the transition starts,the state to which transition moves ,the out put generated and the probability that the transition is taken. In our context each state could represent a set of possible hand postures. The state transitions represent the probability that the certain hand position is changed into other. The corresponding output represents a

specific hand posture and a sequence of postures represent hand gesture. We can a group of HMMs ,one for each gesture and runs a sequence of input data through each HMM. The HMM with highest forward probability determines the most likely hand gesture.

Advantages Of using HMMs:

1.Can recognize large set of postures and gestures.

2.With adequate training, high accuracy can be achieved.

3.Well discussed in the Liturature.

Steps:

1. To select which approach to be used for recognition.

2. To select the tools to be used.

3. Gathering training data and start prototype.

4. Analysing the data which collected in the above step.

5. Some classification of the data based on algorithms.

6. Real time video tracking.

7. Motion Detection using frame by frame analysis .

8. Applying HMM for gesture recognition.

9. Testing

Tools :MATLAB and C++

LATEST PAPERS:

[1] Qing Chen1, Marius D. Cordea1, Emil M. Petriu1, Thomas E. Whale,”Hand-Gesture and Facial-Expression Human-Computer Interfaces for

Intelligent Space Applications

”,University of Ottawa, ON, Canada, CRC, Ottawa, ON, Canada,Budapest Tech Polytechnic Institution, Hungary, Budapest University of Technology and Economics, Hungary

,MeMeA 2008 – IEEE International

Workshop on Medical Measurements and Applications

Ottawa, Ontario, Canada - May 9-10, 2008

.

[2]Reza Hassanpour, Stephan Wong, Asadollah Shahbahrami, ”Vision­Based Hand Gesture Recognition for Human Computer

Interaction: A Review

”,IADIS International Conference Interfaces and Human Computer Interaction 2008.

[3]Qing Chen, Marius D. Cordea

and Emil M. Petriu,”Human–Computer interaction for smart

environment applications using hand gestures

and facial expressions

”,University of Ottawa, 800 King Edward, Ottawa,

Ontario, K1N 6N5, Canada

,Int. J. Advanced Media and Communication, Vol. 3, Nos. 1/2, 2009.

[4] Joseph J. LavioLa Jr ,”A survey of Hand Posture and gesture recognition Techniques and Terminalogy.”,Department of Computer Science ,Brown University ,Providence Rhode Island,02912.

[5]C. Keskin, A. Erkan, L. Akarun,”real time hand tracking and 3d gesture recognition for

interactive interfaces using hmm

”, Computer Engineering Dept.

Boğaziçi University

,E-Mail: ckeskin@ttnet.net.tr, {erkanays,akarun}@boun.edu.t

r

[6] Nguyen Dang Binh, Enokida Shuichi, Toshiaki Ejima,”Real-Time Hand Tracking and Gesture Recognition System”, Nguyen Dang Binh, Enokida Shuichi, Toshiaki Ejima

Intelligence Media Laboratory, Kyushu Institute of Technology

680-4, Kawazu, Iizuka, Fukuoka 820, JAPAN

[ndbinh, enokida, toshi]@mickey.ai.kyutech.ac.jp

, GVIP 05 Conference, 19-21 December 2005, CICC, Cairo, Egypt.