Investigating Notifications and Awareness for Multi-user Multi-touch Tabletop Displays

  • Shuo NiuEmail author
  • D. Scott McCrickard
  • Steve Harrison
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10515)


Notifications seek to guide people’s attention toward timely, relevant, and important tasks and interactions. This work considers situations in which multiple people are sharing a single large display, with collaborative notifications targeted at increasing team awareness of the joint goals, activities, and interactions. Notifications in recent studies show promise in enhancing awareness of the actions of co-located collaborators, but lacking is critical knowledge to guide the evaluation of the benefits and costs of collaborative activities. This paper presents a framework for notifications in a multi-user multi-touch context. The framework is explored for a card-sorting task performed by two people (a participant and a scripted confederate) on a shared tabletop display. Notifications highlight actions performed by each participant to understand changes in social, action, and activity awareness. Our study investigates individual work, social norms and team performance as three co-located factors that are affected by incorporating notifications.


Awareness Notification Multi-user multi-touch Social Action Activity 


  1. 1.
    Al-Qaraghuli, A., Zaman, H.B., Olivier, P., Kharrufa, A., Ahmad, A.: Analysing tabletop based computer supported collaborative learning data through visualization. In: Badioze Zaman, H., Robinson, P., Petrou, M., Olivier, P., Shih, T.K., Velastin, S., Nyström, I. (eds.) IVIC 2011. LNCS, vol. 7066, pp. 329–340. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-25191-7_32 CrossRefGoogle Scholar
  2. 2.
    Bartram, L., Ware, C., Calvert, T.: Moticons: detection, distraction and task. Int. J. Hum. Comput. Stud. 58(5), 515–545 (2003)CrossRefGoogle Scholar
  3. 3.
    Bortolaso, C., Oskamp, M., Phillips, W.G., Gutwin, C., Graham, T.C.N.: The effect of view techniques on collaboration and awareness in tabletop map-based tasks. In: BT - Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces, ITS 2014, Dresden, Germany, 16–19 November 2014 (2014)Google Scholar
  4. 4.
    Carroll, J.M., Neale, D.C., Isenhour, P.L., Rosson, M.B., McCrickard, D.S.S.: Notification and awareness: synchronizing task-oriented collaborative activity. Int. J. Hum. Comput. Stud. 58(5), 605–632 (2003)CrossRefGoogle Scholar
  5. 5.
    Charleer, S., Klerkx, J., Odriozola, S., Luis, J., Duval, E., Santos Odriozola, J.L., Duval, E.: Improving awareness and reflection through collaborative, interactive visualizations of badges. In: ARTEL 13: Proceedings of the 3rd Workshop on Awareness and Reflection in Technology-Enhanced Learning, pp. 69–81. CEUR-WS (2013)Google Scholar
  6. 6.
    Chewar, C.M., McCrickard, D.S., Sutcliffe, A.G.: Unpacking critical parameters for interface design. In: Proceedings of the 2004 Conference on Designing Interactive Systems Processes, Practices, Methods, and Techniques - DIS 2004, Cambridge, MA, USA, p. 279. ACM (2004)Google Scholar
  7. 7.
    Clark, H.H., Brennan, S.S.E.: Grounding in communication. In: Perspectives on Socially Shared Cognition, pp. 127–149 (1991)Google Scholar
  8. 8.
    Van Dantzich, M., Robbins, D., Horvitz, E., Czerwinski, M.: Scope: providing awareness of multiple notifications at a glance. In: Proceedings of the Working Conference on Advanced Visual Interfaces, Trento, Italy, pp. 267–281. ACM (2002)Google Scholar
  9. 9.
    Doucette, A., Gutwin, C., Mandryk, R.: Effects of arm embodiment on implicit coordination, co-presence, and awareness in mixed-focus distributed tabletop tasks. In: Proceedings of the 41st Graphics Interface Conference, Halifax, Nova Scotia, Canada, pp. 131–138. Canadian Information Processing Society (2015)Google Scholar
  10. 10.
    Doucette, A., Gutwin, C., Mandryk, R.L., Nacenta, M.A., Sharma, S.: Sometimes when we touch: how arm embodiments change reaching and collaboration on digital tables. In: Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW 2013), San Antonio, Texas, USA, pp. 193–202. ACM (2013)Google Scholar
  11. 11.
    Dourish, P., Bellotti, V.: Awareness and coordination in shared workspaces. In: Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work, pp. 107–114. ACM, New York (1992)Google Scholar
  12. 12.
    Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors J. Hum. Factors Ergon. Soc. 37(1), 32–64 (1995)CrossRefGoogle Scholar
  13. 13.
    Endsley, M.R., Robertson, M.M.: Situation awareness in aircraft maintenance teams. Int. J. Ind. Ergon. 26(2), 301–325 (2000)CrossRefGoogle Scholar
  14. 14.
    Fan, M., Antle, A.N., Neustaedter, C., Wise, A.F.: Exploring how a co-dependent tangible tool design supports collaboration in a tabletop activity. In: Proceedings of the 18th International Conference on Supporting Group Work (GROUP 2014), Sanibel Island, Florida, USA, pp. 81–90. ACM (2014)Google Scholar
  15. 15.
    Fischer, J.E., Reeves, S., Moran, S., Greenhalgh, C., Benford, S., Rennick-Egglestone, S.: Understanding mobile notification management in collocated groups. In: Bertelsen, O.W., et al. (eds.) ECSCW 2013, pp. 21–44. Springer, London (2013). doi: 10.1007/978-1-4471-5346-7_2 Google Scholar
  16. 16.
    Fussell, S.R., Kraut, R.E., Lerch, F.J., Scherlis, W.L., McNally, M.M., Cadiz, J.J.: Coordination, overload and team performance: effects of team communication strategies. In: Proceedings of the 1998 ACM Conference on Computer Supported Cooperative Work, pp. 275–284. ACM, New York (1998)Google Scholar
  17. 17.
    Fussell, S.R., Kraut, R.E., Siegel, J.: Coordination of communication: effects of shared visual context on collaborative work. In: Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, pp. 21–30. ACM, New York (2000)Google Scholar
  18. 18.
    Gergle, D., Kraut, R.E., Fussell, S.R.: Action as language in a shared visual space. In: Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work, pp. 487–496. ACM, New York (2004)Google Scholar
  19. 19.
    Gergle, D., Kraut, R.E., Fussell, S.R.: Language efficiency and visual technology. J. Lang. Soc. Psychol. 23(4), 491–517 (2004)CrossRefGoogle Scholar
  20. 20.
    Gergle, D., Kraut, R.E., Fussell, S.R.: Using visual information for grounding and awareness in collaborative tasks. Hum.-Comput. Interact. 28(1), 1–39 (2013)Google Scholar
  21. 21.
    Di Giacomo, E., Lubiw, A., Zimmer, B., Kerren, A., Cernea, D., Weber, C., Kerren, A., Ebert, A.: Group affective tone awareness and regulation through virtual agents. In: Bickmore, T., Marsella, S., Sidner, C. (eds.) IEEE Information Visualization, pp. 247–259. Springer, Heidelberg (2014)Google Scholar
  22. 22.
    Gutwin, C., Greenberg, S.: A descriptive framework of workspace awareness for real-time groupware. Comput. Support. Coop. Work (CSCW) 11(3–4), 411–446 (2002)CrossRefGoogle Scholar
  23. 23.
    Gutwin, C., Greenberg, S.: Design for individuals, design for groups: tradeoffs between power and workspace awareness. In: Proceedings of the Conference on Computer-Supported Cooperative Work, Seattle, Washington, USA, pp. 207–216. ACM (1998)Google Scholar
  24. 24.
    Gutwin, C., Roseman, M., Greenberg, S.: A usability study of awareness widgets in a shared workspace groupware system. In: Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work, pp. 258–267. ACM, New York (1996)Google Scholar
  25. 25.
    Hinrichs, U., Carpendale, S.: Gestures in the wild. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI 2011, Vancouver, BC, Canada, p. 3023. ACM (2011)Google Scholar
  26. 26.
    Hornecker, E., Marshall, P., Dalton, N.S., Rogers, Y.: Collaboration and interference: awareness with mice or touch input. In: Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work, pp. 167–176. ACM, New York (2008)Google Scholar
  27. 27.
    Hudson, W.: Card sorting. In: The Encyclopedia of Human-Computer Interaction, 2nd edn. (2013)Google Scholar
  28. 28.
    Ion, A., Chang, Y.-L.B., Haller, M., Hancock, M., Scott, S.D.: Canyon: providing location awareness of multiple moving objects in a detail view on large displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI 2013, Paris, France, p. 3149. ACM (2013)Google Scholar
  29. 29.
    Isenberg, P., Elmqvist, N., Scholtz, J., Cernea, D., Ma, K.-L., Hagen, H., Kwan-Liu Ma, K.-L., Hagen, H.: Collaborative visualization: definition, challenges, and research agenda. In: Information Visualization, pp. 310–326. SAGE Publications, London (2011)Google Scholar
  30. 30.
    Isenberg, P., Fisher, D., Paul, S.A., Morris, M.R., Inkpen, K., Czerwinski, M., Paul, S.A., Morris, M.R., Inkpen, K., Czerwinski, M.: An exploratory study of co-located collaborative visual analytics around a tabletop display. In: 2010 IEEE Symposium on Visual Analytics Science and Technology (VAST), Salt Lake City, Utah, USA, pp. 179–186. IEEE (2010)Google Scholar
  31. 31.
    Isenberg, P., Tang, A., Carpendale, S.: An exploratory study of visual information analysis. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy, pp. 1217–1226. ACM (2008)Google Scholar
  32. 32.
    Kohn, M.L., Schooler, C.: Work and Personality: An Inquiry into the Impact of Social Stratification. Ablex Publishing, Norwood (1983)Google Scholar
  33. 33.
    Kruger, R., Carpendale, S., Scott, S.D., Greenberg, S.: Roles of orientation in tabletop collaboration: comprehension, coordination and communication. Comput. Support. Coop. Work 13(5–6), 501–537 (2004)CrossRefGoogle Scholar
  34. 34.
    Lee, J., Tatar, D., Harrison, S.: Micro-coordination: because we did not already learn everything we need to know about working with others in kindergarten. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW 2012), Seattle, Washington, USA, pp. 1135–1144. ACM (2012)Google Scholar
  35. 35.
    Mark, G., Fuchs, L., Sohlenkamp, M.: Supporting groupware conventions through contextual awareness. In: Hughes, J.A., Prinz, W., Rodden, T., Schmidt, K. (eds.) Proceedings of the Fifth European Conference on Computer Supported Cooperative Work, pp. 253–268. Springer, Dordrecht (1997). doi: 10.1007/978-94-015-7372-6_17 CrossRefGoogle Scholar
  36. 36.
    Mark, G., Kobsa, A., Gonzalez, V., Clark, H.H., Brennan, S.E., Endsley, M.R., Robertson, M., Rittenbruch, M., Salmon, P.M., Stanton, N.A., Walker, G.H., Baber, C., Jenkins, D.P., McMaster, R., Young, M.S.: What really is going on? Review of situation awareness models for individuals and teams. In: Proceedings of Sixth International Conference on Information Visualisation, vol. 14, no. 2, pp. 127–149 (2002)Google Scholar
  37. 37.
    Marshall, P., Hornecker, E., Morris, R., Dalton, N.S., Rogers, Y.: When the fingers do the talking: a study of group participation with varying constraints to a tabletop interface. In: 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems (TABLETOP 2008), pp. 33–40 (2008)Google Scholar
  38. 38.
    McCrickard, D.S., Abel, T.D., Scarpa, A., Wang, Y., Niu, S.: Collaborative design for young children with autism: design tools and a user study. In: 2015 International Conference on Collaboration Technologies and Systems (CTS), pp. 175–182. IEEE (2015)Google Scholar
  39. 39.
    McCrickard, D.S., Chewar, C.M.: Attuning notification design to user goals and attention costs (2003).
  40. 40.
    McCrickard, D.S.S., Czerwinski, M., Bartram, L.: Introduction: design and evaluation of notification user interfaces. Int. J. Hum. Comput. Stud. 58(5), 509–514 (2003)CrossRefGoogle Scholar
  41. 41.
    Monk, A.: Common ground in electronically mediated communication: Clark’s theory of language use (2014)Google Scholar
  42. 42.
    Morris, M.R., Fisher, D., Wigdor, D.: Search on surfaces: exploring the potential of interactive tabletops for collaborative search tasks. Inf. Process. Manag. 46(6), 703–717 (2010)CrossRefGoogle Scholar
  43. 43.
    Morris, M.R., Lombardo, J., Wigdor, D.: WeSearch: supporting collaborative search and sensemaking on a tabletop display. In: Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW 2010), Savannah, Georgia, USA, pp. 401–410. ACM (2010)Google Scholar
  44. 44.
    Morris, M.R., Paepcke, A., Winograd, T., Stamberger, J.: TeamTag: exploring centralized versus replicated controls for co-located tabletop groupware. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Montréal, Québec, Canada, pp. 1273–1282. ACM (2006)Google Scholar
  45. 45.
    Morris, M.R., Ryall, K., Shen, C., Forlines, C., Vernier, F.: Beyond “social protocols”: multi-user coordination policies for co-located groupware (2004)Google Scholar
  46. 46.
    Paul, C.L., Komlodi, A., Lutters, W.: Interruptive notifications in support of task management. Int. J. Hum. Comput. Stud. 79, 20–34 (2015)CrossRefGoogle Scholar
  47. 47.
    Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., Saarikko, P.: It’s Mine, Don’t Touch!: interactions at a large multi-touch display in a city centre. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008), Florence, Italy, pp. 1285–1294. ACM (2008)Google Scholar
  48. 48.
    Piper, A.M., O’Brien, E., Morris, M.R., Winograd, T.: SIDES: a cooperative tabletop computer game for social skills development. In: Proceedings of the 2006 ACM Conference on Computer Supported Cooperative Work (CSCW 2006), Banff, Alberta, Canada, pp. 1–10. ACM (2006)Google Scholar
  49. 49.
    Reeves, B., Nass, C.: How People Treat Computers, Television, and New Media Like Real People and Places. CSLI Publications and Cambridge University Press, Cambridge (1996)Google Scholar
  50. 50.
    Rittenbruch, M.: Atmosphere: a framework for contextual awareness. Int. J. Hum.-Comput. Interact. 14(2), 159–180 (2002)CrossRefGoogle Scholar
  51. 51.
    Rogers, Y., Hazlewood, W., Blevis, E., Lim, Y.-K.: Finger talk: collaborative decision-making using talk and fingertip interaction around a tabletop display. In: CHI ’04 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2004), Vienna, Austria, pp. 1271–1274. ACM (2004)Google Scholar
  52. 52.
    Ryall, K., Forlines, C., Shen, C., Morris, M.R.: Exploring the effects of group size and table size on interactions with tabletop shared-display groupware. In: Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work - CSCW 2004, Chicago, Illinois, USA, p. 284. ACM (2004)Google Scholar
  53. 53.
    Salas, E., Prince, C., Baker, D.P., Shrestha, L.: Situation awareness in team performance: implications for measurement and training. Hum. Factors J. Hum. Factors Ergon. Soc. 37(1), 123–136 (1995)CrossRefGoogle Scholar
  54. 54.
    Scott, S.D., Carpendale, M.S.T., Inkpen, K.M., Sheelagh, M., Carpendale, T., Inkpen, K.M.: Territoriality in collaborative tabletop workspaces. In: Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW 2004), Chicago, Illinois, USA, pp. 294–303. ACM (2004)Google Scholar
  55. 55.
    Scott, S.D., Grant, K.D., Mandryk, R.L.: System guidelines for co-located, collaborative work on a tabletop display. In: Kuutti, K., et al. (eds.) ECSCW 2003, pp. 159–178. Springer, Dordrecht (2003). doi: 10.1007/978-94-010-0068-0_9 Google Scholar
  56. 56.
    Niu, S., McCrickard, D.S., Nguyen, S.M.: Learning with interactive tabletop displays. In: 2016 IEEE Frontiers in Education Conference (FIE), pp. 1–9. IEEE (2016)Google Scholar
  57. 57.
    Smith, K., Hancock, P.A.: Situation awareness is adaptive, externally directed consciousness. Hum. Factors J. Hum. Factors Ergon. Soc. 37(1), 137–148 (1995)CrossRefGoogle Scholar
  58. 58.
    Tang, A., Pahud, M., Carpendale, S., Buxton, B.: VisTACO: visualizing tabletop collaboration. In: ACM International Conference on Interactive Tabletops and Surfaces, Saarbrücken, Germany pp. 29–38. ACM (2010)Google Scholar
  59. 59.
    Tang, A., Tory, M., Po, B., Neumann, P., Carpendale, S.: Collaborative coupling over tabletop displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2006), Montréal, Québec, Canada, pp. 1181–1190. ACM (2006)Google Scholar
  60. 60.
    Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA, pp. 1083–1092. ACM (2009)Google Scholar
  61. 61.
    Zagermann, J., Pfeil, U., Rädle, R., Jetter, H.-C., Klokmose, C., Reiterer, H.: When tablets meet tabletops: the effect of tabletop size on around-the-table collaboration with personal tablets. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, Santa Clara, California, USA, pp. 5470–5481. ACM (2016)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2017

Authors and Affiliations

  • Shuo Niu
    • 1
    Email author
  • D. Scott McCrickard
    • 1
  • Steve Harrison
    • 1
  1. 1.Computer Science DepartmentVirginia TechBlacksburgUSA

Personalised recommendations