Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description

Lee-Na, Teh and W. Yeo, Alvin (2009) Multilingual multimodal integration of sketch and speech: A generic speech representation model for spatial description. International Conference on Asian Language Processing: Recent Advances in Asian Language Processing, IALP 2009. pp. 17-22. ISSN 978-076953904-1

[img]
Preview
PDF
05380790 (abstrak).pdf

Download (310kB) | Preview
Official URL: http://ieeexplore.ieee.org/document/5380790/

Abstract

This paper details how multiple languages are accommodated in the multimodal integration of sketch and speech, specifically, in spatial applications. The study encompasses English, Malay, Mandarin, and two under-resourced languages in Malaysia, i.e. Melanau and Iban. The preliminary study revealed that not all spatial terms (prepositions) appear in all languages. Based on these findings, we propose a method to assist in the design and development of multilingual multimodal applications. This method employs a generic representation model for spatial description.

Item Type: Article
Additional Information: Information, Communication and Creative Technology
Uncontrolled Keywords: Design and Development, Generic representation, Malaysia, Multimodal application, Multimodal integration, Multiple languages, Representation model, Spatial applications, Spatial descriptions, unimas, university, universiti, Borneo, Malaysia, Sarawak, Kuching, Samarahan, ipta, education, research, Universiti Malaysia Sarawak
Subjects: Q Science > QA Mathematics > QA76 Computer software
Divisions: Academic Faculties, Institutes and Centres > Faculty of Computer Science and Information Technology
Faculties, Institutes, Centres > Faculty of Computer Science and Information Technology
Academic Faculties, Institutes and Centres > Faculty of Computer Science and Information Technology
Depositing User: Saman
Date Deposited: 09 Nov 2017 08:45
Last Modified: 30 Sep 2022 03:12
URI: http://ir.unimas.my/id/eprint/18511

Actions (For repository members only: login required)

View Item View Item