Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages

Loh, Ngiik Hoon and Siti Shukhaila, Binti Shaharuddin (2019) Accuracy Performance and Potentiality of Real-Time Avatar Lip Sync Animation in Different Languages. International Journal of Recent Technology and Engineering, 7 (6S2). pp. 57-66. ISSN 2277-3878

[img] PDF
Loh, Ngiik Hoon.pdf

Download (1MB)
Official URL:


With the fast growth in computing power nowadays, the qualities of animation enable an extra layer of visually con-vincing realism. In lip sync animation, creation of realistic lip movement is arduous in getting the lip shape and position to syn-chronize with the speech sounds.To note, spendinghours in manually generating every single lip movement can be a long and challengingtask.Consequently,acomprehensive analysis on viseme based multiple phonemes in English, Bahasa Melayu and Mandarin was carried out, to develop anaccurate and potential platform forrealtime talkingavatar inmultiple languages.The accuracy performancebetween human and avatar in real timewere compared and evaluated. The findings revealed successfulutilization of real time synchronization to drive the synthetic 3D avatars based on live speechinputfor multiple languages, with satisfiedaccurate lip motion result.This paper provides useful knowledge for multilingual solution which accurately predicts mouth movement on real human face, when a person is speaking and directs to lip sync process. Itcontributesto live performances and valuable inopen-ended fieldwith tons of potential, such as animation productionindustry, entertainment, gaming, digital marketingand media education.

Item Type: Article
Uncontrolled Keywords: Avatar; Human Lip Shape; Lip Sync Animation; Real Time; Speech Recognition, unimas, university, universiti, Borneo, Malaysia, Sarawak, Kuching, Samarahan, ipta, education, , research, Universiti Malaysia Sarawak.
Subjects: L Education > L Education (General)
T Technology > T Technology (General)
Divisions: Academic Faculties, Institutes and Centres > Faculty of Applied and Creative Arts
Depositing User: Shaharuddin
Date Deposited: 08 May 2019 01:48
Last Modified: 24 May 2021 02:44

Actions (For repository members only: login required)

View Item View Item