Skip to main content
SpringerLink
Log in

A Middleware for Implicit Interaction

  • Chapter
Computing with Instinct

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5897))

Abstract

Achieving intuitive and seamless interaction with computational artifacts remains a cherished objective for HCI professionals. Many have a vested interest in the achievement of this objective as usability remains a formidable barrier to the acceptance of technology in many domains and by various groups within the general population. Indeed, the potential of computing in its diverse manifestations will not be realized fully until such time as communication between humans and computational objects can occur transparently and instinctively in all instances. One step towards achieving this is to harness the various cues that people normally use when communicating as such cues augment and enrich the communication act. Implicit interaction offers a model by which this may be understood and realized; however, implementing a solution that effectively harnesses implicit interaction is problematic. This chapter presents an intelligent middleware framework as a means for harnessing the disparate data sources necessary for capturing and interpreting implicit interaction events.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Maybury, M.T., Wahlster, W. (eds.): Readings in Intelligent User Interfaces. Morgan Kaufmann Publishers Inc., San Francisco (1998)

    Google Scholar 

  2. Argyle, M., Slater, V., Nicholson, H., Williams, M., Burgess, P.: The Communication of Inferior and Superior Attitudes by Verbal and Non-verbal Signals. British Journal of Social and Clinical Psychology 9, 221–231 (1970)

    Article  Google Scholar 

  3. Ekman, P., Friesen, W.V.: The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding. Semiotica 1, 49–97 (1969)

    Article  Google Scholar 

  4. Ambady, N., Rosenthal, R.: Thin Slices of Expressive Behavior as Predictors of Interpersonal Consequences: A meta-analysis. Psychological Bulletin 1(11), 256–274 (1992)

    Article  Google Scholar 

  5. Ekman, P., Rosenberg, E.L. (eds.): What the Face Reveals: Basic and Applied Studies of Spontaneous Expression using the FACS. Oxford University Press, Oxford (2005)

    Google Scholar 

  6. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J.: Emotion Recognition in Human-Computer Interaction. IEEE Signal Processing Magazine 18(1), 32–80 (2001)

    Article  Google Scholar 

  7. Oviatt, S.: Multimodal Interactive Maps: Designing for Human Performance. HumanComputer Interaction 12(1), 93–129 (1997)

    Article  Google Scholar 

  8. Sebe, N.: Multimodal Interfaces: Challenges and Perspectives. Journal of Ambient Intelligence and smart environments 1(1), 23–30 (2009)

    Google Scholar 

  9. Kuchenbecker, K.J., Fiene, J., Niemeyer, G.: Improving Contact Realism through Event-based Haptic Feedback. IEEE Transactions on Visualization and Computer Graphics 12(2), 219–230 (2006)

    Article  Google Scholar 

  10. Charumporn, B., Omatu, S.: Classifying Smokes using an Electronic Nose and Neural Networks. In: Proceedings of the 41st SICE Annual Conference, vol. 5, pp. 2661–2665 (2002)

    Google Scholar 

  11. Ciosek, P., Wróblewski, W.: Sensor Arrays for Liquid Sensing – Electronic Tongue Systems. Analyst 132, 963–978 (2007)

    Article  Google Scholar 

  12. Johnston, M., Bangalore, S.: Finite-state Multimodal Integration and Understanding. Journal of Natural Language Engineering 11(2), 159–187 (2005)

    Article  Google Scholar 

  13. Schmidt, A.: Implicit Human Computer Interaction through Context. In: Personal Technologies, vol. 4(2&3), pp. 191–199. Springer, Heidelberg (2000)

    Google Scholar 

  14. Vinciarelli, A., Pantic, M., Bourlard, H.: Social signal processing: Survey of an emerging domain. Image and Vision Computing 27(12), 1743–1759 (2009)

    Article  Google Scholar 

  15. Norman, D.A.: The Design of Everyday Things. Doubleday (1989)

    Google Scholar 

  16. Dix, A., Finley, J., Abowd, G., Beale, R.: Human–Computer Interaction, 3rd edn. Prentice-Hall, Englewood Cliffs (2004)

    MATH  Google Scholar 

  17. Obrenovic, Z., Starcevic, D.: Modeling Multimodal Human–Computer Interaction. IEEE Computer 37(9), 65–72 (2004)

    Article  Google Scholar 

  18. Greenberg, S.: Context as a Dynamic Construct. Human-Computer Interaction 16(2–4), 257–268 (2001)

    Article  Google Scholar 

  19. Dey, A.: Modeling and Intelligibility in Ambient Environments. Journal of Ambient Intelligence and smart environments 1(1), 57–62 (2009)

    Google Scholar 

  20. Gu, T., Pung, H.K., Zhang, D.Q.: A Bayesian Approach for Dealing with Uncertain Contexts. In: Proceedings of Advances in Pervasive Computing, pp. 205–210 (2004)

    Google Scholar 

  21. Henricksen, K., Indulska, J.: Developing Context-aware Pervasive Computing Applications: Models and Approach. Pervasive and Mobile Computing 2(1), 37–64 (2006)

    Article  Google Scholar 

  22. Chen, H., Finin, T., Joshi, A.: An Ontology for Context-Aware Pervasive Computing Environments. Knowledge Engineering Review 18(3), 197–207 (2004)

    Article  Google Scholar 

  23. Ranganathan, A., Campbell, R.: An Infrastructure for Context-awareness Based on First Order Logic. Personal Ubiquitous Computing 7(6), 353–364 (2003)

    Article  Google Scholar 

  24. Ye, J., Coyle, L., Dobson, S., Nixon, P.: Ontology-based Models in Pervasive Computing Systems. Knowledge Engineering Review 22(4), 315–347 (2007)

    Article  Google Scholar 

  25. Loke, S.W.: Representing and Reasoning with Situations for Context-aware Pervasive Computing: A Logic Programming Perspective. Knowledge Engineering Review 19(3), 213–233 (2004)

    Article  Google Scholar 

  26. Schilit, B., Adams, N., Want, R.: Context-Aware Computing Applications. In: Workshop on Mobile Computing Systems and Applications, pp. 85–90. IEEE, New York (1994)

    Google Scholar 

  27. Henricksen, K., Indulska, J.: Modelling and Using Imperfect Context Information, pp. 33–37. IEEE, New York (2004)

    Google Scholar 

  28. Anagnostopoulos, C.B., Ntarladimas, Y., Hadjiefthymiades, S.: Situational Computing: An Innovative Architecture with Imprecise Reasoning. System and Software 80(12), 1993–2014 (2007)

    Article  Google Scholar 

  29. Ye, J., McKeerver, S., Coyle, L., Neely, S., Dobson, S.: Resolving Uncertainty in Context Integration and Abstraction. In: Proceedings of the International Conference on Pervasive Services, pp. 131–140. ACM, New York (2008)

    Chapter  Google Scholar 

  30. Ranganathan, A., Al-Muhtadi, J., Campbell, R.: Reasoning about Uncertain Contexts in Pervasive Computing Environments. IEEE Pervasive Computing 3(2), 1268–1536 (2004)

    Article  Google Scholar 

  31. Ding, Z., Peng, Y.: A Probabilistic Extension to Ontology Language OWL. In: Proceedings of the 37th Hawaii International Conference on System Sciences, pp. 1–10 (2004)

    Google Scholar 

  32. Truong, B.A., Lee, Y.-K., Lee, S.-Y.: Modeling Uncertainty in Context-Aware Computing. In: Proceedings of the Fourth Annual ACIS International Conference on Computer and Information Science (ICIS 2005), pp. 676–681 (2005)

    Google Scholar 

  33. Dargie, W.: The Role of Probabilistic Schemes in Multisensor Context-Awareness. In: Proceedings of Fifth Annual IEEE International Conference on Pervasive Computing and Communications Workshops, pp. 27–32 (2007)

    Google Scholar 

  34. Ye, J., Coyle, L., Dobson, S., Nixon, P.: Using Situation Lattices to Model and Reason about Context. In: Proceedings of the Workshop on Modeling and Reasoning Context, pp. 1–12 (2007)

    Google Scholar 

  35. Hoffman, J.C., Murphy, R.R.: Comparison of Bayesian and Dempster-Shafer theory for sensing: a practitioner’s approach. In: Proceedings of Neural and Stochastic Methods in Image and Signal Processing II, pp. 266–279 (1993)

    Google Scholar 

  36. Ye, J., Dobson, S., Nixon, P.: An Overview of Pervasive Computing Systems. In: Augmented Materials and Smart Objects: Building Ambient Intelligence through Microsystems Technology, pp. 3–17. Springer, Heidelberg (2008)

    Google Scholar 

  37. Dey, A.: Modeling and Intelligibility in Ambient Environments. Journal of Ambient Intelligence and Smart Environments 1, 57–62 (2009)

    Google Scholar 

  38. O’Hare, G.M.P., O’Grady, M.J., Muldoon, C., Bradley, J.F.: Embedded Agents: A Paradigm for Mobile Services. Int. Journal of Web and Grid Services 2(4), 379–405 (2006)

    Article  Google Scholar 

  39. O’Hare, G.M.P., O’Grady, M.J.: Addressing Mobile HCI Needs through Agents. In: Paternó, F. (ed.) Mobile HCI 2002. LNCS, vol. 2411, pp. 311–314. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  40. Hagras, H., Callaghan, V., Colley, M., Clarke, G., Pounds-Cornish, A., Duman, H.: Creating an Ambient-Intelligence Environment Using Embedded Agents. IEEE Intelligent Systems 19(6), 12–20 (2004)

    Article  Google Scholar 

  41. O’Grady, M.J., O’Hare, G.M.P., Sas, C.: Mobile Agents for Mobile Tourists: A User Evaluation of Gulliver’s Genie. Interacting with Computers 17(4), 343–366 (2005)

    Article  Google Scholar 

  42. Keegan, S., O’Hare, G.M.P., O’Grady, M.J.: EasiShop: Ambient Intelligence Assists Everyday Shopping. Information Sciences 178(3), 588–611 (2008)

    Article  Google Scholar 

  43. Wooldridge, M., Jennings, N.R.: Intelligent Agents: Theory and Practice. The Knowledge Engineering Review 10(2), 115–152 (1995)

    Article  Google Scholar 

  44. Bernstein, P.A.: Middleware: A Model for Distributed System Services. Communications of the ACM 39(2), 86–98 (1996)

    Article  Google Scholar 

  45. Riva, O., Kangasharju, J.: Challenges and Lessons in Developing Middleware on Smart Phones. Computer 41, 23–31 (2008)

    Article  Google Scholar 

  46. Fok, C., Roman, G., Lu, C.: Mobile Agent Middleware for Sensor Networks: An Application Case Study.In: IPSN (2005)

    Google Scholar 

  47. Yaici, K., Kondoz, A.: Runtime Middleware for the Generation of Adaptive User Interfaces on Resource-constrained Devices. In: Third International Conference on Digital Information Management, pp. 587–592 (2008)

    Google Scholar 

  48. Repo, P., Riekki, J.: Middleware Support for Implementing Context-aware Multimodal User Interfaces. In: Proceedings of the 3rd International Conference on Mobile and Ubiquitous Multimedia( MUM 2004), pp. 221–227. ACM, New York (2004)

    Chapter  Google Scholar 

  49. Tynan, R., O’Hare, G.M.P., O’Grady, M.J.: Agency, Ambience, Assistance: A Framework for Practical AAL. In: Augusto, J.C., Corchado, J.M., Novais, P., Analide, C. (eds.) Advances in Soft Computing, vol. 72, pp. 209–212. Springer, Heidelberg (2010)

    Google Scholar 

  50. Muldoon, C., O’Hare, G.M.P., Collier, R., O’Grady, M.J.: Towards Pervasive Intelligence: Reflections on the Evolution of the Agent Factory Framework. In: Bordini, R.H., Dastani, M., Dix, J., Fallah-Seghrouchni, A.E. (eds.) Multi-Agent Programming: Languages, Platforms and Applications, pp. 187–210. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  51. Costa, R., Carneiro, D., Novais, P., Lima, L., Machado, J., Marques, A., Neves, J.: Ambient Assisted Living. In: Advances in Soft Computing, vol, pp. 86–94. Springer, Heidelberg (2008)

    Google Scholar 

  52. Bernhaupt, R., Obrist, M., Weiss, A., Beck, E., Tscheligi, M.: Trends in the living room and beyond. In: Cesar, P., Chorianopoulos, K., Jensen, J.F. (eds.) EuroITV 2007. LNCS, vol. 4471, pp. 146–155. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  53. Smith, R.B.: SPOTWorld and the Sun SPOT. In: Proceedings of the 6th International Conference on Information Processing in Sensor Networks, pp. 565–566 (2007)

    Google Scholar 

  54. Walsh, M., O’Grady, M.J., Dragone, M., Tynan, R., Ruzzelli, A., Barton, J., O’Flynn, B., O’Hare, G.M.P., O’Mathuna, C.: The CLARITY Modular Ambient Health and Wellness Measurement Platform. In: Proceedings of the Fourth International Conference on Sensor Technologies and Applications (SENSORCOMM), pp. 577–583 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CLARITY: Centre for Sensor Web Technologies, School of Computer Science & Informatics, University College Dublin, Belfield, Dublin 4, Ireland

    M. J. O’Grady, J. Ye, G. M. P. O’Hare, S. Dobson, R. Tynan, R. Collier & C. Muldoon

Authors
  1. M. J. O’Grady
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. G. M. P. O’Hare
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. S. Dobson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. R. Tynan
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. R. Collier
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. C. Muldoon
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Ambient Intelligence Lab, CIC-2218, Carnegie Mellon University, 4720 Forbes Avenue, 15213, Pittsburgh, PA, USA

    Yang Cai

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

O’Grady, M.J. et al. (2011). A Middleware for Implicit Interaction. In: Cai, Y. (eds) Computing with Instinct. Lecture Notes in Computer Science(), vol 5897. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19757-4_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19757-4_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19756-7

  • Online ISBN: 978-3-642-19757-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation