3D Lips Development and Measurement for Visual Speech Synthesis

Salleh, Siti Salwa and Rahmat, Rahmita Wirza and Mahmod, Ramlan and Ahmad, Fatimah (2009) 3D Lips Development and Measurement for Visual Speech Synthesis. European Journal of Scientific Research, 35 (2). pp. 159-172. ISSN 1450-216X

Full text not available from this repository.

Abstract

This paper presents works involves in developing a three-dimensional lips model to be used in a visual speech synthesis. Even though several works have been done in similar areas, but a systematic approach of identifying and determining the number of vertices used in the lips model for visual speech synthesis were not explained thoroughly. Instead of the development technique involved, this paper also present experimental design and set up to test the capabilities and flexibility of the lips in deforming speech. The work starts with the process of capturing the lips shape using 3D scanner and then the number of vertices reduced using relevance measure technique in order to achieve the optimum number of vertices to deform all visemes in Standard Malay. Results shown in this work proves that a systematic degradation of 10,000 vertices into 60 vertices by retaining 0.0006% of the initial vertices managed to be done. We also found out that the deformation of the lips with smaller number of vertices is still remaining the similar quality of the lips deformation of the 150 or 100 vertices. Therefore, the outcome of this study proposes and justifies the appropriate number of vertices to be used in visual speech synthesis in our future work.

Item Type:Article
Keyword:3D Lips, Visual Speech Synthesis, Relevence Measure, Polygonal Construct, Similarity Measurement
Subject:Synthetic speech - facial animation
Subject:Speech processing systems
Subject:Automatic speech recognition
Faculty or Institute:Faculty of Computer Science and Information Technology
ID Code:12638
Deposited By: Umikalthom Abdullah
Deposited On:02 Nov 2011 08:04
Last Modified:16 Nov 2011 11:12

Repository Staff Only: item control page

Document Download Statistics

This item has been downloaded for since 02 Nov 2011 08:04.

View statistics for "3D Lips Development and Measurement for Visual Speech Synthesis"


Universiti Putra Malaysia Institutional Repository

Universiti Putra Malaysia Institutional Repository is an on-line digital archive that serves as a central collection and storage of scientific information and research at the Universiti Putra Malaysia.

Currently, the collections deposited in the IR consists of Master and PhD theses, Master and PhD Project Report, Journal Articles, Journal Bulletins, Conference Papers, UPM News, Newspaper Cuttings, Patents and Inaugural Lectures.

As the policy of the university does not permit users to view thesis in full text, access is only given to the first 24 pages only.