Abstract
The communication itself is considered as a multimodal interactive process binding speech with other modalities. In this contribution some results of the project MobilTel (Mobile Multimodal Telecommunications System) are presented. It has provided a research framework resulting in a develop-ment of mobile terminal (PDA) based multimodal interface, enabling user to obtain information from internet by multimodal way through wireless telecommunication network. The MobilTel communicator is a speech centric multimodal system with speech interaction capabilities in Slovak language supplemented with graphical modalities. The graphical modalities are pen – touch screen interaction, keyboard, and display on which the information is more user friendly presented, and provides hyperlink and scrolling menu availability. The architecture of the MobilTel communicator and methods of interaction between PDA and MobilTel communicator are described. The graphical examples of services that enable users to obtain information about weather or information about train connection are also presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Juhár, J., Ondáš, S., Čižmár, A., Rusko, M., Rozinaj, G., Jarina, R.: Development of Slovak GALAXY/VoiceXML Based Spoken Language Dialogue System to Retrieve Information from the Internet. In: Interspeech 2006 - ICSLP, Pittsburgh, USA, September 17-21, pp. 485–488 (2006)
Slovak testing dialog available on skype: irkr_pub, http://irkr.tuke.sk/
Young, S.: ATK: An application Toolkit for HTK, version 1.3, January 2004. Cambridge University, Cambridge (2004)
Lamere, P., Kwok, P., Walker, W., Gouvea, E., Singh, R., Raj, B., Wolf, P.: Design of the CMU Sphinx-4 decoder. In: Proc. Eurospeech 2003, Geneve, Switzerland, pp. 1181–1184 (September 2003)
Mirilovič, M., Lihan, S., Juhár, J., Čižmár, A.: Slovak speech recognition based on Sphinx-4 and SpeechDat-SK. In: Proc. DSP-MCOM 2005, Košice, Slovakia, pp. 76–79 (September 2005)
Lindberg, B., Johansen, F.T., Warakagoda, N., Lehtinen, G., Kačič, Z., Žgank, A., Elenius, K., Salvi, G.: A noise robust multilingual reference recognizer based on SpeechDat (II). In: Proc. ICSLP 2000, Beijing, China (2000)
Lihan, S., Juhár, J., Čižmár, A.: Crosslingual and Bilingual Speech Recognition with Slovak and Czech SpeechDat-E Databases. In: Proc. Interspeech 2005, Lisabon, Portugal, pp. 225–228 (September 2005)
Winski, R.: Definition of corpus, scripts and standards for fixed networks, Technical report, SpeechDat-II, Deliverable SD1.1.1., workpackage WP1 (January 1997)
Pollak, P., Černocký, J., Boudy, J., Choukri, K., Rusko, M., Trnka, M.: SpeechDat(E) Eastern European Telephone Speech Databases. In: Proc. LREC 2000 Satellite workshop XLDB - Very large Telephone Speech Databases, Athens, Greece, pp. 20–25 (May 2000)
Rusko, M., Trnka, M., Darjaa, S.: MobilDat-SK - A Mobile Telephone Extension to the SpeechDat-E SK Telephone Speech Database in Slovak, accepted for SPEECOM 2006, Sankt Peterburg, Russia (July 2006)
Darjaa, S., Rusko, M., Trnka, M.: Three Generations of Speech Synthesis Systems in Slovakia, accepted for SPEECOM 2006, Sankt Peterburg, Russia (July 2006)
Ondáš, S., Juhár, J.: Dialogue manager based on the VoiceXML interpreter. In: Proc. DSP-MCOM 2005, Košice, Slovakia, pp. 80–83 (September 2005)
Gladišová, I., Doboś, Č., Juhár, J., Ondáš, S.: Dialog Design for Telephone Based Meteorological Information System. In: Proc. DSP-MCOM 2005, Košice, Slovakia, pp. 151–154 (2005)
GUI testing website, http://147.232.47.73:8888/jar/index.html
MobilTel project website: http://mobiltel.tuke.sk/
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pleva, M. et al. (2007). Towards to Mobile Multimodal Telecommunications Systems and Services. In: Esposito, A., Faundez-Zanuy, M., Keller, E., Marinaro, M. (eds) Verbal and Nonverbal Communication Behaviours. Lecture Notes in Computer Science(), vol 4775. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76442-7_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-76442-7_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76441-0
Online ISBN: 978-3-540-76442-7
eBook Packages: Computer ScienceComputer Science (R0)