Hand Gesture Recognition Using Artificial Neural Networks

Mustafa, Mohd Amrallah (2007) Hand Gesture Recognition Using Artificial Neural Networks. Masters thesis, Universiti Putra Malaysia.

[img] PDF
92Kb

Abstract

Hand gesture has been part of human communication, where, young children usually communicate by using gesture before they can talk. Adults may have to also gesture if they need to or they are indeed mute or deaf. Thus the idea of teaching a machine to also learn gestures is very appealing due to its unique mode of communications. A reliable hand gesture recognition system will make the remote control become obsolete. However, many of the new techniques proposed are complicated to be implemented in real time, especially as a human machine interface. This thesis focuses on recognizing hand gesture in static posture. Since static hand postures not only can express some concepts, but also can act as special transition states in temporal gestures recognition, thus estimating static hand postures is in fact a big topics in gesture recognition. A database consists of 200 gesture images have been built, where five volunteers had help in the making of the database. The images were captured in a controlled environment and the postures are free from occlusion where the background is uncluttered and the hand is assumed to have been localized. A system was then built to recognize the hand gesture. The captured image will be first preprocessed in order to binarize the palm region, where Sobel edge detection technique has been employed, with later followed by morphological operation. A new feature extraction technique has been developed, based on horizontal and vertical states transition count, and the ratio of hand area with respect to the whole area of image. These set of features have been proven to have high intra class dissimilarity attributes. In order to have a system that can be easily trained, artificial neural networks has been chosen in the classification stage. A multilayer perceptron with back-propagation algorithm has been developed, thus the system is actually in-built to be used as a human machine interface. The gesture recognition system has been built and tested in Matlab, where simulations have shown promising results. The performance of recognition rate in this research is 95% which shows a major improvement in comparison to the available methods.

Item Type:Thesis (Masters)
Subject:Gesture - Malaysia
Subject:Neural networks - neurobiology
Chairman Supervisor:Mohammad Hamiruce Marhaban, PhD
Call Number:FK 2007 2
Faculty or Institute:Faculty of Engineering
ID Code:614
Deposited By: Yusfauhannum Mohd Yunus
Deposited On:16 Oct 2008 11:52
Last Modified:27 May 2013 06:49

Repository Staff Only: item control page

Document Download Statistics

This item has been downloaded for since 16 Oct 2008 11:52.

View statistics for "Hand Gesture Recognition Using Artificial Neural Networks"


Universiti Putra Malaysia Institutional Repository

Universiti Putra Malaysia Institutional Repository is an on-line digital archive that serves as a central collection and storage of scientific information and research at the Universiti Putra Malaysia.

Currently, the collections deposited in the IR consists of Master and PhD theses, Master and PhD Project Report, Journal Articles, Journal Bulletins, Conference Papers, UPM News, Newspaper Cuttings, Patents and Inaugural Lectures.

As the policy of the university does not permit users to view thesis in full text, access is only given to the first 24 pages only.