UPM Institutional Repository

Algorithm of local features fusion and modified covariance-matrix technique for hand motion position estimation and hand gesture trajectory tracking approach


Citation

Thabet, Eman and Khalid, Fatimah and Sulaiman, Puteri Suhaiza and Yaakob, Razali (2020) Algorithm of local features fusion and modified covariance-matrix technique for hand motion position estimation and hand gesture trajectory tracking approach. Multimedia Tools and Applications, 80. pp. 5287-5318. ISSN 1380-7501; ESSN: 1573-7721

Abstract

Nowadays, visual recognition based dynamic hand gesture tracking has gained very considerable attention. Hand gestures can play an important role as a non-touchable communication tool between machines and humans based on using the affordable built-in webcam. The need for replacing touch-based computing devices interaction has been increasing in many fields like healthcare, security, and generally as interface-based devices controlling. Especially with COVID19 outbreak spreading around the world, where people take a risk and avoid dealing with electronic consumer machines that required hand touching. However, in any dynamic hand gesture recognition system, dynamic hand gesture tracking is a very hard task, where position estimation over video frames for freely moving hand in the air is quite challenging. This shortcoming is due to hand great scale changes, posture variations, and translation problems. Hence, to tackle these difficulties and extract gesture features for gesture recognition phase accurately, this paper proposed an algorithm of dynamic hand trajectory tracking for gesture recognition. The presented algorithm proposes local features fusion based on Gabor-Canny- Hog features embedded an updated compact covariance matrix technique as sophisticated feature-based tracking, utilizing video sequences of IBGHT dataset. As a result, the proposed approach has shown adorable optimization achieving an accuracy rate of 96.97%, overcoming the problems of hand appearance variation in the complicated environment.


Download File

[img] Text (Abstract)
ABSTRACT.pdf

Download (6kB)

Additional Metadata

Item Type: Article
Divisions: Faculty of Computer Science and Information Technology
DOI Number: https://doi.org/10.1007/s11042-020-09903-5
Publisher: Springer
Keywords: Hand gesture tracking; Gabor filter; Brisk feature; Fast marching method (FMM); Entropy filter; Region covariance matrix (RCM); Minimum eigenvalue; Hog feature; Canny feature
Depositing User: Ms. Nuraida Ibrahim
Date Deposited: 15 Jun 2022 04:40
Last Modified: 15 Jun 2022 04:40
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.1007/s11042-020-09903-5
URI: http://psasir.upm.edu.my/id/eprint/87794
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item