A Multimodal Contact List to Enhance Remote Communication

  • Andrew Crossan
  • Grégoire Lefebvre
  • Sophie Zijp-Rouzier
  • Roderick Murray-Smith
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8045)


The Multimodal Contact List provides a mechanism to browse context information and communicate with friends in a contact list both visually and through touch and sound. Each contact can share with their friend group selected information on their current context such as mood and availability. Users are able to gain a quick overview of the context provided over all of their contacts, allowing them to close the loop with them via touch, audio, visual feedback or a combination of all three. A user can then progressively probe the contact for more detailed information, eventually allowing the user to open a real-time multimodal voice and tactile communication channel to the contact for verbal or discreet tactile communication.


Multimodal Mobile Remote Communication Vibrotactile Feedback 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ahmaniemi, T., Marila, J., Lantz, V.: Design of Dynamic Vibrotactile Textures. IEEE Transactions on Haptics 3(4), 245–256 (2010)CrossRefGoogle Scholar
  2. 2.
    Bales, E., Li, K.A., Griwsold, W.: CoupleVIBE: mobile implicit communication to improve awareness for (long-distance) couples. In: Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (2011)Google Scholar
  3. 3.
    Brown, L.M., Williamson, J.: Shake-to-talk: Multimodal Messaging for Interpersonal Communication. In: Proceedings of the 2nd International Workshop on Haptic and Audio Interaction Design, Seoul, Korea (2007)Google Scholar
  4. 4.
    Chang, A., O’Modhrain, S., Jacob, R., Gunther, E., Ishii, H.: ComTouch: design of a vibrotactile communication device. In: Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, p. 320. ACM (2002)Google Scholar
  5. 5.
    Dey, A.K., Hakkila, J.: Context-Awareness and Mobile Computing. In: Lumdsen, J. (ed.) Handbook of Research on User Interface Design and Evaluation for Mobile Technology, ch. 13. Idea Group, Inc. (2008)Google Scholar
  6. 6.
    Heikkinen, J., Olsson, T., Vaananen-Vainio-Mattila, K.: Expectations for user experience in haptic communication with mobile devices. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2009). ACM, New York (2009)Google Scholar
  7. 7.
    Hemmert, F., Gollner, U., Löwe, M., Wohlauf, A., Joost, G.: Intimate mobiles: grasping, kissing and whispering as a means of telecommunication in mobile phones. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, Stockholm, Sweden, August 30-September 02 (2011)Google Scholar
  8. 8.
    Kaye, J.: I just clicked to say I love you: rich evaluations of minimal communication. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2006), pp. 363–368. ACM, New York (2006)Google Scholar
  9. 9.
    Kim, S., Kientz, J.A., Patel, S.N., Abowd, G.D.: Are you sleeping?: sharing portrayed sleeping status within a social network. In: Proceedings of the ACM Conference on Computer Supported Cooperative Work, pp. 619–628. ACM (2008)Google Scholar
  10. 10.
    King, D.: Four principles of interpersonal communication, (accessed June 10, 2010)
  11. 11.
    Kontaris, D., Harrison, D., Patsoule, E., Zhuang, S., Slade, A.: Feelybean: communicating touch over distance. In: Proceedings of the 2012 ACM Annual Conference Extended Abstracts on Human Factors in Computing Systems Extended Abstracts, CHI EA 2012 (2012)Google Scholar
  12. 12.
    Murray-Smith, R., Ramsay, A., Garrod, S., Jackson, M., Musizza, B.: Gait alignment in mobile phone conversations. In: Proceedings ACM MobileHCI, pp. 214–221. ACM, New York (2007)Google Scholar
  13. 13.
    Rico, J., Brewster, S.: Gestures all around us: user differences in social acceptability perceptions of gesture based interfaces. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2009, Bonn, Germany, September 15-18, pp. 1–2. ACM, New York (2009)Google Scholar
  14. 14.
    Rovers, A.F., van Essen, H.A.: HIM: A framework for haptic instant messaging. In: CHI 2004 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2004), pp. 1313–1316. ACM, New York (2004)CrossRefGoogle Scholar
  15. 15.
    Sellen, A.J.: Remote conversations: The effects of mediating talk with technology. Human-Computer Interaction 10, 401–444 (1995)CrossRefGoogle Scholar
  16. 16.
    Shirazi, A.S., Schmidt, A.: Using Mobile Phones to Maintain Intimacy and Connectedness. In: Proceedings of MobileHCI (2011)Google Scholar
  17. 17.
    Strachan, S., Williamson, J., Murray-Smith, R.: Show me the way to Monte Carlo: density-based trajectory navigation. In: Proceedings of ACM SIG CHI Conference, San Jose, pp. 1245–1248 (2007)Google Scholar
  18. 18.
    Tünnermann, R., Mertes, C., Hermann, T.: Feelabuzz – Direct Tactile Communication with Mobile Phones. In: Proceedings of Workshop on Mobile Social Signal Processing (2012)Google Scholar
  19. 19.
    Wang, R., Quek, F.: Touch & talk: contextualizing remote touch for affective interaction. In: Proceedings of the Fourth International Conference on TEI, pp. 13–20. ACM (2010)Google Scholar
  20. 20.
    Williamson, J.R., Crossan, A., Brewster, S.: Multimodal Mobile Interactions: Usability Studies in Real World Settings. In: Proceedings of ICMI, Alicante, Spain, pp. 361–368. ACM Press (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Andrew Crossan
    • 1
  • Grégoire Lefebvre
    • 2
  • Sophie Zijp-Rouzier
    • 2
  • Roderick Murray-Smith
    • 3
  1. 1.School of Engineering and Built EnvironmentGlasgow Caledonian UniversityGlasgowScotland
  2. 2.Orange LabsMeylanFrance
  3. 3.School of Computing ScienceUniversity of GlasgowGlasgowScotland

Personalised recommendations