Abstract
Future pervasive environments are expected to immerse users in a consistent world of probes, sensors and actuators. Multimodal interfaces combined with social computing interactions and high-performance networking can foster a new generation of pervasive environments. However, much work is still needed to harness the full potential of multimodal interaction. In this paper we discuss some short-term research goals, including advanced techniques for joining and correlating multiple data flows, each with its own approximations and uncertainty models. Also, we discuss some longer term objectives, like providing users with a mental model of their own multimodal “aura”, enabling them to collaborate with the network infrastructure toward inter-modal correlation of multimodal inputs, much in the same way as the human brain extracts a single self-conscious experience from multiple sensorial data flows.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abowd, G.D., Mynatt, E.D.: Charting past, present, and future research in ubiquitous computing. ACM Transactions on Computer Human Interaction 7(1), 29–58 (2000)
Feki, M.A., Renouard, S., Abdulrazak, B., Chollet, G., Mokhtari, M.: Coupling context awareness and multimodality in smart homes concept. In: Miesenberger, K., Klaus, J., Zagler, W.L., Burger, D. (eds.) ICCHP 2004. LNCS, vol. 3118, pp. 906–913. Springer, Heidelberg (2004)
Oikonomopoulos, A., Patras, I., Pantic, M.: Human action recognition with spatiotemporal salient points. IEEE Transactions on Systems, Man and Cybernetics. Part B 36(3), 710–719 (2006)
Anisetti, M., Bellandi, V.: Emotional State Inference Using Face Related Features. New Directions in Intelligent Interactive Multimedia Systems and Services 2, 401–411 (2009)
Damiani, E., Anisetti, M., Bellandi, V.: Toward Exploiting Location-based and Video Information in Negotiated Access Control Policies. In: International Conference on Information Systems Security, Calcutta, India (2005)
Pantic, M.: Affective Computing. In: Pagani, M. (ed.) Encyclopedia of Multimedia Technology and Networking, Hershy, PA, USA, May 2005, vol. 1, pp. 8–14. Idea Group Reference (2005)
Damiani, E., Khosla, R., Sethi, I.K.: Intelligent multimedia multi-agent systems: a human-centered approach. Kluwer, Dordrecht (September 2001)
Dubois, D., Prade, H.: Can we enforce full compositionality in uncertainty calculi. In: Proc. of the 11th Nat. Conf. on Artificial Intelligence (AAAI 1994), pp. 149–154. AAAI Press/MIT Press (1994)
Lukasiewicz, T., Straccia, U.: Description logic programs under probabilistic uncertainty and fuzzy vagueness. In: Mellouli, K. (ed.) ECSQARU 2007. LNCS (LNAI), vol. 4724, pp. 187–198. Springer, Heidelberg (2007)
Lukasiewicz, T., Straccia, U.: Uncertainty and vagueness in description logic programs for the semantic web (2007)
Antoniou, G., Bikakis, A.: Dr-prolog: A system for defeasible reasoning with rules and ontologies on the semantic web. IEEE Trans. Knowl. Data Eng. 19(2), 233–245 (2007)
Bobillo, F., Delgado, M., Gomez-Romero, J.: Extending fuzzy description logics with a possibilistic layer. In: URSW. CEUR Workshop Proceedings, vol. 327, CEUR-WS.org (2007)
Dubois, D., Mengin, J., Prade, H.: Possibilistic uncertainty and fuzzy features in description logic. A preliminary discussion. In: Sanchez, E. (ed.) Fuzzy logic and the semantic web, pp. 101–113. Elsevier, Amsterdam (2006), DMenP001
Luo, X., Zhang, C., Jennings, N.R.: A hybrid model for sharing information between fuzzy, uncertain and default reasoning models in multi-agent systems. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 10(4), 401–450 (2002)
Van Melle, W.J.: A domain-independent system that aids in constructing knowledge-based consultation programs. PhD thesis, Stanford, CA, USA (1980)
Shortlife, E.H., Buchanan, B.G.: A model of inexact reasoning in medicine. pp. 259–275 (1990)
Zadeh, L.A.: Fuzzy sets. Information Control, 338–353 (1965)
Coutaz, J., Crowley, J.L., Dobson, S., Garlan, D.: Context is Key. Comm. of the ACM 48(3) (March 2005)
Bonatti, P.A., Samarati, P.: Logics for Authorization and Security. In: Logics for Emerging Applications of Databases 2003, pp. 277–323 (2003)
Damiani, E., Anisetti, M., Bellandi, V.: Toward Exploiting Location-based and Video Information in Negotiated Access Control Policies. In: International Conference on Information Systems Security (ICISS 2005), India (2005)
Sheth, A., Henson, C., Sahoo, S.S.: Semantic Sensor Web. IEEE Internet Computing (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer Berlin Heidelberg
About this chapter
Cite this chapter
Anisetti, M., Bellandi, V., Ceravolo, P., Damiani, E. (2010). Multimodality in Pervasive Environment. In: Tsihrintzis, G.A., Damiani, E., Virvou, M., Howlett, R.J., Jain, L.C. (eds) Intelligent Interactive Multimedia Systems and Services. Smart Innovation, Systems and Technologies, vol 6. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14619-0_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-14619-0_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14618-3
Online ISBN: 978-3-642-14619-0
eBook Packages: EngineeringEngineering (R0)