Skip to main content
SpringerLink
Log in

Natural Human–Computer Interaction

  • Chapter
Multimedia Interaction and Intelligent User Interfaces

Part of the book series: Advances in Pattern Recognition ((ACVPR))

Abstract

Research work in relation to Natural Human–Computer Interaction concerns the theorization and development of systems that understand and recognize human communicative actions in order to engage people in a dialogue between them and their surroundings.

Natural interaction is defined in terms of “experience”: people communicate in a natural way through vocal, gestural, and emotional expressions, exploring the environments through the vision and manipulation of physical objects. The key is then to allow them to interact with technology in the same way they interact with each other in everyday life.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hewett, Baecker, Card, Carey, Gasen, Mantei, Perlman, Strong, Verplank: ACM SIGCHI, Curricula for Human–Computer Interaction (1997). http://old.sigchi.org/cdg/. Accessed 15 April 2010

  2. Wania, C.E., Atwood, M.E., McCain, K.W.: How do design and evaluation interrelate in HCI research. In: Proceedings of the 6th Conference on Designing Interactive Systems, pp. 90–98. ACM, New York (2006)

    Chapter  Google Scholar 

  3. Norman, D.A.: The Design of Everyday Things. MIT Press, Cambridge (1998)

    Google Scholar 

  4. Marsic, I., Medl, A., Flanagan, J.: Natural communication with information systems. Proc. IEEE 88(8), 1354–1366 (2000)

    Article  Google Scholar 

  5. Norman, D.A.: The Invisible Computer. MIT Press, Cambridge (1999)

    Google Scholar 

  6. Weiser, M., Brown, J.S.: Designing calm technology. PowerGrid Journal, vol. 1.01 (1996)

    Google Scholar 

  7. Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proc. ACM CHI on Human Factors in Computing Systems Conference (1997)

    Google Scholar 

  8. Fishkin, K.P.: A taxonomy for and analysis of tangible interfaces. Pers. Ubiquitous Comput. 8(5), 347–358 (2004)

    Article  Google Scholar 

  9. Baraldi, S., Del Bimbo, A., Landucci, L., Torpei, N., Cafini, O., Farella, E., Pieracci, A., Benini, L.: Introducing TANGerINE: a tangible interactive natural environment. In: Proc. ACM Multimedia (2007)

    Google Scholar 

  10. Suzuki, K., Horiba, I., Sugie, N.: Linear-time connected-component labeling based on sequential local operations. Comput. Vis. Image Underst. (2003). doi:10.1016/S1077-3142(02)00030-9

    Google Scholar 

  11. Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. (2006). doi:10.1145/1177352.1177355

    Google Scholar 

  12. Welch, G., Bishop, G.: An introduction to the Kalman filter. Technical Report, TR 95-041, University of North Carolina at Chapel Hill (2004)

    Google Scholar 

  13. Wan, E.A., der Merwe, R.V.: The unscented Kalman filter for non-linear estimation. In: Proc. of Symposium 2001 on Adaptive Systems for Signal Processing, Communications and Control (2000)

    Google Scholar 

  14. Arulampalam, S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for on-line non-linear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. (2002). doi:10.1234/12345678

    MATH  Google Scholar 

  15. Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 780–785 (1997)

    Article  Google Scholar 

  16. Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: Proc. of CVPR, pp. 246–252 (1999)

    Google Scholar 

  17. Butz, A., Hilliges, O., Terrenghi, L., Baur, D.: Hybrid widgets on an interactive tabletop. In: Extended Abstracts of the Ninth International Conference on Ubiquitous Computing (2007)

    Google Scholar 

  18. Kakehi, Y., Naemura, T., Matsushita, M.: Tablescape plus: interactive small-sized vertical displays on a horizontal tabletop display. In: TABLETOP ’07, Second Annual IEEE International Workshop on Digital Object, pp. 155–162 (2007)

    Google Scholar 

  19. Leitner, J., Haller, M., Yun, K., Woo, W., Sugimoto, M., Inami, M.: IncreTable, a mixed reality tabletop game experience. In: Proc. of the 2008 International Conference on Advances in Computer Entertainment Technology (2008). doi:10.1145/1501750.1501753

  20. Hu, T.-T., Chia, Y.-W., Chan, L.-W., Hung, Y.-P., Hsu, J.: I-m-Top: an interactive multi-resolution tabletop system accommodating to multi-resolution human vision. In: Horizontal Interactive Human Computer Systems (2008). doi:10.1109/TABLETOP.2008.4660202

  21. Chan, L.-W., Hu, T.-T., Lin, J.-Y., Hung, Y.-P., Hsu, J.: On top of tabletop: a virtual touch panel display. In: Horizontal Interactive Human Computer Systems (2008). doi:10.1109/TABLETOP.2008.4660201

  22. Kim, M., Cho, Y., Park, K.S.: Design and development of a distributed tabletop system using EBITA framework. In: Ubiquitous Information Technologies & Applications (2009). doi:10.1109/ICUT.2009.5405719

  23. Hartmann, B., Morris, M.R., Benko, H., Wilson, A.D.: Pictionaire: supporting collaborative design work by integrating physical and digital artifacts. In: Proc. of the 2010 ACM Conference on Computer Supported Cooperative Work (2010). doi:10.1145/1718918.1718989

  24. Cao, X., Lindley, S.E., Helmes, J., Sellen, A.: Telling the whole story: anticipation, inspiration and reputation in a field deployment of TellTable. In: Proc. of the 2010 ACM Conference on Computer Supported Cooperative Work (2010). doi:10.1145/1718918.1718967

  25. Morris, M.R., Lombardo, J., Wigdor, D.: WeSearch: supporting collaborative search and sensemaking on a tabletop display. In: Proc. of the 2010 ACM Conference on Computer Supported Cooperative Work (2010). doi:10.1145/1718918.1718987

  26. Leichtenstern, K., Andre, E., Losch, E., Kranz, M., Holleis, P.: A tangible user interface as interaction and presentation device to a social learning software. In: Networked Sensing Systems (2007). doi:10.1109/INSS.2007.4297402

  27. Kranz, M., Schmidt, D., Holleis, P., Schmidt, A.: A display cube as tangible user interface. In: Adjunct Proc. of the Seventh International Conference on Ubiquitous Computing (Demo 22) (2005)

    Google Scholar 

  28. Jacoby, S., Gutwillig, G., Jacoby, D., Josman, N., Weiss, P.L., Koike, M., Itoh, Y., Kawai, N., Kitamura, Y., Sharlin, E.: PlayCubes: monitoring constructional ability in children using a tangible user interface and a playful virtual environment. In: Virtual Rehabilitation International Conference, pp. 42–49 (2009)

    Google Scholar 

  29. Kitamura, Y., Itoh, Y., Kishino, F.: Real-time 3D interaction with ActiveCube. In: CHI ’01 Extended Abstracts on Human Factors in Computing Systems (2001). doi:10.1145/634067.634277

  30. Rigler, J., Seldess, Z.: The music Cre8tor: an interactive system for musical exploration and education. In: Proc. of the 7th International Conference on New Interfaces for Musical (2007). doi:10.1145/1279740.1279842

  31. Sitdhisanguan, K., Chotikakamthorn, N., Dechaboon, A., Out, P.: Evaluation the efficacy of computer-based training using tangible user interface for low-function children with autism. In: Digital Games and Intelligent Toys Based Education (2008). doi:10.1109/DIGITEL.2008.28

  32. Ullmer, B., Ishii, H., Jacob, R.J.: Token+constraint systems for tangible interaction with digital information. ACM Trans. Comput.-Hum. Interact (2005). doi:10.1145/1057237.1057242

  33. Boussemart, B., Giroux, S.: Tangible user interfaces for cognitive assistance. In: Proc. of the 21st International Conference on Advanced Information Networking and Applications Workshops (2007). doi:10.1109/AINAW.2007.346

  34. Billinghurst, M., Kato, H., Poupyrev, I.: Tangible augmented reality. In: ACM SIGGRAPH ASIA 2008 Courses (2008). doi:10.1145/1508044.1508051

  35. Molyneaux, D., Gellersen, H.: Projected interfaces: enabling serendipitous interaction with smart tangible objects. In: Proc. of the 3rd International Conference on Tangible and Embedded Interaction (2009). doi:10.1145/1517664.1517741

  36. Harfield, A., Jormanainen, I., Shujau, H.: First steps in distributed tangible technologies: a virtual tug of war. In: Proc. of the 8th International Conference on Interaction Design and Children (2009). doi:10.1145/1551788.1551822

  37. Hansen, A.S., Overholt, D., Burleson, W., Jensen, C.N., Lahey, B., Muldner, K.: Pendaphonics: an engaging tangible pendulum-based sonic interaction experience. In: Proceedings of the 8th International Conference on Interaction Design and Children (2009). doi:10.1145/1551788.1551859

  38. Potamianos, G.: Audio-visual technologies for lecture and meeting analysis inside smart rooms. In: Proc. HCSNet Workshop on the Use of Vision in Human–Computer Interaction (2006)

    Google Scholar 

  39. Potamianos, G., Zhang, Z.: A joint system for single-person 2D-face and 3D-head tracking in CHIL seminars. In: Stiefelhagen, R., Garofolo, J. (eds.), Lecture Notes in Computer Science, vol. 4122. Springer, Berlin (2006)

    Google Scholar 

  40. Hummel, K.A., et al.: Supporting meetings with a goal-driven service-oriented multimedia environment. In: 1st ACM International Workshop on Multimedia Service Composition (2005)

    Google Scholar 

  41. Yu, Z., Ozeki, M., Fujii, Y., Nakamura, Y.: Towards smart meeting: enabling technologies and a real-world application. In: Proc. of the 9th ACM International Conference on Multimodal Interfaces (2007). doi:10.1145/1322192.1322210

  42. Chen, H., Perich, F., Chakraborty, D., Finin, T., Joshi, A.: Intelligent agents meet semantic web in a smart meeting room. In: IEEE Internet Computing, pp. 854–861 (2004)

    Google Scholar 

  43. Veenman, C., Reinders, M., Backer, E.: Resolving motion correspondence for densely moving points. IEEE Trans. Pattern Anal. Mach. Intell. 23, 54–72 (2001)

    Article  Google Scholar 

  44. Serby, D., Meier, E., Van Gool, L.: Probabilistic object tracking using multiple features. In: Proc. 17th International Conference on Pattern Recognition, vol. 2, pp. 184–187 (2004)

    Google Scholar 

  45. Isard, M., Blake, A.: CONDENSATION—conditional density propagation for visual tracking. Int. J. Comput. Vis. 29, 5–28 (1998)

    Article  Google Scholar 

  46. Comaniciu, D., Ramesh, V., Meer, P.: Kernel based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25, 564–575 (2003)

    Article  Google Scholar 

  47. Yilmaz, A., Li, X., Shah, M.: Contour-based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans. Pattern Anal. Mach. Intell. 26, 1531–1536 (2004)

    Article  Google Scholar 

  48. Nummiaro, K., Koller-Meier, E., Gool, L.V.: An adaptive color-based particle filter. Image Vis. Comput. 21, 99–110 (2002)

    Article  Google Scholar 

  49. Bagdanov, A.D., Dini, F., Del Bimbo, A., Nunziati, W.: Improving the robustness of particle filter-based visual trackers using online parameter adaptation. In: Proc. of IEEE International Conference on Advanced Video and Signal based Surveillance (2007)

    Google Scholar 

  50. Allen, J.G., Xu, R.Y.D., Jin, J.S.: Object tracking using CamShift algorithm and multiple quantized feature spaces. In: Proc. of VIP ’05, Australian Computer Society, Inc. (2005)

    Google Scholar 

  51. Baraldi, S., Del Bimbo, A., Landucci, L., Torpei, N., Cafini, O., Farella, E., Zappi, P., Benini, L.: Tangerine SMCube: a smart device for human computer interaction. In: Proc. of 3th European Conference on Smart Sensing & Context (2008)

    Google Scholar 

  52. Viola, P., Jones, M.: Robust real-time object detection. Int. J. Comput. Vis. (2001). doi:10.1234/12345678

    Google Scholar 

Download references

Author information

Authors and Affiliations

    Authors
    1. Gianpaolo D’Amico
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Alberto Del Bimbo
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Fabrizio Dini
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Lea Landucci
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Nicola Torpei
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Alberto Del Bimbo .

    Editor information

    Editors and Affiliations

    1. , Dept Electronic & Electrical Engineering, University of Sheffield, Mappin Street, Sheffield, S1 3JD, United Kingdom

      Ling Shao

    2. Philips Research, High Tech Campus 36, Eindhoven, 5656 AE, Netherlands

      Caifeng Shan

    3. Kodak Research Laboratories, Lake Avenue 1999, Rochester, 14650, New York, USA

      Jiebo Luo

    4. , Service & Solution Development Dept, NTT DoCoMo, Inc., Hikarinooka 3-6, Yokosuka, 239-8536, Kanagawa, Japan

      Minoru Etoh

    Rights and permissions

    Reprints and permissions

    Copyright information

    © 2010 Springer-Verlag London Limited

    About this chapter

    Cite this chapter

    D’Amico, G., Del Bimbo, A., Dini, F., Landucci, L., Torpei, N. (2010). Natural Human–Computer Interaction. In: Shao, L., Shan, C., Luo, J., Etoh, M. (eds) Multimedia Interaction and Intelligent User Interfaces. Advances in Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-84996-507-1_4

    Download citation

    • DOI: https://doi.org/10.1007/978-1-84996-507-1_4

    • Publisher Name: Springer, London

    • Print ISBN: 978-1-84996-506-4

    • Online ISBN: 978-1-84996-507-1

    • eBook Packages: Computer ScienceComputer Science (R0)

    Publish with us

    Policies and ethics

    Search

    Navigation