Abstract
In this paper we present an innovative approach for exploiting the handheld device hardware increasing power. These results have been achieved in the framework of a larger project aimed to the definition of a platform to build mobile multimodal applications. Such project, called CHAT, has been co-funded by Italian Ministry of Research. Focusing our attention on the system client side, we will show how it is possible to use a thin client approach for building high modular client interfaces, managing asynchronous interactions originated on the server-side, eventually pushing contents using different criteria (e.g. change of the environmental context). We have studied how to build mobile multimodal clients, adopting an innovative approach based on the aggregation of what we have called “multimodal objects” that are able to exploit the benefits of both telecommunication and web protocols to manage input/output processes. Furthermore, we will report some restrictions and constraints coming from the adoption of two different environments: .NET and J2ME. We will highlight our solid experiences in this area and some prelimi-nary results of our research.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Frattini, G., Romano, L., di Scotto Carlo, V., Petriccione, P., Supino, G., Leone, G., Autiero, C.: Multimodal Architectures: Issues and Experiences. In: Meersman, R., Tari, Z., Herrero, P. (eds.) OTM 2006 Workshops. LNCS, vol. 4277, pp. 974–983. Springer, Heidelberg (2006)
Frattini, G., Gaudino, F., Scotto di Carlo, V.: Mobile multimodal applications on mass-market devices: experiences - 18th International Workshop on Database and Expert Systems Applications (DEXA 2007). In: Wagner, R., Revell, N., Pernul, G. (eds.) DEXA 2007. LNCS, vol. 4653, pp. 89–93. Springer, Heidelberg (2007)
XUL (Last accessed December 12, 2007), www.mozilla.org/projects/xul/
Kirusa (Last accessed March 20, 2008), www.kirusa.com
Nuance (Last accessed March 20, 2008), www.nuance.com
X+V for the Next Generation Web, http://www.voicexml.org/specs/multimodal/
Niklfeld, G., Anegg, H., Pucher, M., Schatz, R., Simon, R., Wegscheider, F., Gassner, A., Jank, M., Pospischil, G.: Device independent mobile multimodal user interfaces with the MONA Multimodal Presentation Server. In: Proceedings of Eurescom Summit 2005, Heidelberg, Germany, April 27-29 (2005)
Reitter, D., Panttaja, E., Cummins, F.: UI on the fly: Generating a multimodal user interface. In: Proceedings of Human Language Technology conference 2004 / North American chapter of the Association for Computational Linguistics (HLT/NAACL 2004) (2004)
Filippo, F., Krebs, A., Marsic, I.: A framework for rapid development of multimodal interfaces. In: Proceedings of the 5th international conference on Multimodal interfaces, November 5-7, Vancouver, British Columbia, Canada (2003)
Piccolo (last accessed February 20, 2008), http://www.cs.umd.edu/hcil/jazz/index.shtml
Thinlet classic (Last accessed March 20, 2007), http://www.thinlet.com/
Zap. The mozilla SIP client (Last accessed April 13, 2007), http://croczilla.com/zap
Android (last accessed March 7, 2007), http://code.google.com/android/
JavaFX (last accessed March 7, 2007), http://www.sun.com/software/javafx/mobile/
PJSIP (last accessed March 7, 2007), http://www.pjsip.org/
Loquendo vocal technology and services, www.loquendo.com
Jarnal (Last accessed March 5, 2008), www.dklevine.co/general/software/tc1000/jarnal.htm
Avola, D., Ferri, F., Grifoni, P.: Formalizing Recognition of Sketching Styles in Human Centered Systems. In: Apolloni, B., Howlett, R.J., Jain, L. (eds.) KES 2007, Part II. LNCS (LNAI), vol. 4693. Springer. Heidelberg (2007)
Avola, D., Caschera, M.C., Ferri, F., Grifoni, P.: Ambiguities in Sketch-Based Interfaces. In: Proceedings of the Hawaii International Conference on System Sciences (HICSS 2007), vol. 290. IEEE Computer Society, Los Alamitos (2007)
Foster, M.E.: State of the art review: Multimodal fission (2002), www.hcrc.ed.ac.uk/comic/documents/deliverables/Del6-1.pdf
Asterisk SIP Server (last accessed March 7,2007), http://www.asterisk.org/
SMIL Specification, last accessed March 7th (2007), http://www.w3.org/TR/REC-smil/
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Frattini, G. et al. (2008). A New Approach Toward a Modular Multimodal Interface for PDAs and Smartphones. In: Sebillo, M., Vitiello, G., Schaefer, G. (eds) Visual Information Systems. Web-Based Visual Information Search and Management. VISUAL 2008. Lecture Notes in Computer Science, vol 5188. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85891-1_21
Download citation
DOI: https://doi.org/10.1007/978-3-540-85891-1_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85890-4
Online ISBN: 978-3-540-85891-1
eBook Packages: Computer ScienceComputer Science (R0)