Advertisement

The Smartwatch in Multi-device Interaction

  • Donald McMillanEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10289)

Abstract

Wearable devices are typically not used on their own. Indeed, many are sold specifically as companion devices to mobile phones. Here, we take a close look at smartwatch use in its natural multi-device context, building on a corpus of 1009 in vivo smartwatch use incidents recorded with twelve participants over 168 h. We examine closely four exemplar clips, exploring glances for information during other tasks, maintenance tasks that allow the allocation of spare attention, the smartwatch in conversation around media consumption, and the physical constraints of its embodied use on the wrist alongside other devices. Our study sheds light on current smartwatch use practices alongside devices with more established use scenarios, and on how the smartwatch changes and disrupts those practices.

Keywords

Smartwatch Video analysis Multi-device interaction 

References

  1. 1.
    Akkil, D., et al.: Glance awareness and gaze interaction in smartwatches. In: Presented at the Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (2015)Google Scholar
  2. 2.
    Bandelloni, R., Paternò, F.: Migratory user interfaces able to adapt to various interaction platforms. Int. J. Hum Comput Stud. 60(5–6), 621–639 (2004)CrossRefGoogle Scholar
  3. 3.
    Bardram, J.E.: Activity-based computing for medical work in hospitals. ACM Trans. Comput. Hum. Interact. 16(2), 10:1–10:36 (2009)CrossRefGoogle Scholar
  4. 4.
    Brown, B., et al.: iPhone in vivo: Video analysis of mobile device use. In: Proceedings of CHI 2013, Paris, France. ACM Press, New York (2013)Google Scholar
  5. 5.
    Baudisch, P., Chu, G.: Back-of-device interaction allows creating very small touch devices. In: Presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2009)Google Scholar
  6. 6.
    Brown, B., et al.: 100 days of iPhone use: Understanding the details of mobile device use. In: Presented at the Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services (2014). doi: 10.1145/2628363.2628377
  7. 7.
    Brown, B., et al.: Searchable objects: Search in everyday conversation. In: Presented at the Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (2015)Google Scholar
  8. 8.
    Cecchinato, M.E., et al.: Smartwatches: The good, the bad and the ugly? In: Presented at the Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (2015)Google Scholar
  9. 9.
    Cha, J.-M., et al.: Virtual sliding QWERTY: A new text entry method for smartwatches using Tap-N-Drag. Appl. Ergon. 51, 263–272 (2015)CrossRefGoogle Scholar
  10. 10.
    Chen, W.-H.: Blowatch: Blowable and hands-free interaction for smartwatches. In: Presented at the Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (2015)Google Scholar
  11. 11.
    Dearman, D., Pierce, J.S.: It’s on my other computer!: Computing with multiple devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 767–776 ACM, New York (2008)Google Scholar
  12. 12.
    Dunlop, M.D., et al.: Towards high quality text entry on smartwatches. In: Presented at the CHI 2014 Extended Abstracts on Human Factors in Computing Systems (2014)Google Scholar
  13. 13.
    Giang, W.C.W., et al.: Smartwatches vs. smartphones: A preliminary report of driver behavior and perceived risk while responding to notifications. In: Presented at the Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (2015). doi: 10.1145/2799250.2799282
  14. 14.
    Grudin, J.: Partitioning digital worlds: Focal and peripheral awareness in multiple monitor use. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 458–465. ACM, New York (2001)Google Scholar
  15. 15.
    Heath, C., et al.: Configuring awareness. Comput. Support. Coop. Work (CSCW) 11(3), 317–347 (2002)CrossRefGoogle Scholar
  16. 16.
    Heath, C., Luff, P.: Technology in Action. Cambridge University Press, Cambridge (2000)CrossRefGoogle Scholar
  17. 17.
    Hennfng, R.A., et al.: Microbreak length, performance, and stress in a data entry task. Ergonomics 32(7), 855–864 (1989)CrossRefGoogle Scholar
  18. 18.
    Hey, T., Trefethen, A.: The data deluge: An e-Science perspective. In: Grid Computing: Making the Global Infrastructure a Reality, pp. 809–824. Wiley (2003)Google Scholar
  19. 19.
    Holz, C., Baudisch, P.: The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In: Presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2010)Google Scholar
  20. 20.
    Holz, C., Baudisch, P.: Understanding touch. In: Presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2011)Google Scholar
  21. 21.
    Hong, J., et al.: SplitBoard: A simple split soft keyboard for wristwatch-sized touch screens. In: Presented at the Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015)Google Scholar
  22. 22.
    Jokela, T., et al.: A diary study on combining multiple information devices in everyday activities and tasks. In: Presented at the Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015)Google Scholar
  23. 23.
    Kane, S.K., Karlson, A.K., Meyers, B.R., Johns, P., Jacobs, A., Smith, G.: Exploring cross-device web use on PCs and mobile devices. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 722–735. Springer, Heidelberg (2009). doi: 10.1007/978-3-642-03655-2_79 CrossRefGoogle Scholar
  24. 24.
    Karlson, A.K., et al.: Mobile taskflow in context: A screenshot study of smartphone usage. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2009–2018. ACM, New York (2010)Google Scholar
  25. 25.
    Komninos, A., Dunlop, M.: Text input on a smart watch. IEEE Pervasive Comput. 13(4), 50–58 (2014)CrossRefGoogle Scholar
  26. 26.
    Kratz, S., Rohs, M.: HoverFlow: Expanding the design space of around-device interaction. In: Presented at the Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (2009)Google Scholar
  27. 27.
    Lyons, K.: What can a dumb watch teach a smartwatch? Informing the design of smartwatches. In: Presented at the Proceedings of the 2015 ACM International Symposium on Wearable Computers (2015)Google Scholar
  28. 28.
    Mainwaring, S.D., Anderson, K., Chang, M.F.: Living for the global city: Mobile kits, urban interfaces, and ubicomp. In: Beigl, M., Intille, S., Rekimoto, J., Tokuda, H. (eds.) UbiComp 2005. LNCS, vol. 3660, pp. 269–286. Springer, Heidelberg (2005). doi: 10.1007/11551201_16 CrossRefGoogle Scholar
  29. 29.
    McMillan, D., et al.: From in the wild to in vivo: Video analysis of mobile device use. In: Presented at the Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (2015)Google Scholar
  30. 30.
    McMillan, D., et al.: Situating wearables: Smartwatch use in context. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM (2017)Google Scholar
  31. 31.
    Mehrotra, A., et al.: My phone and me: Understanding people’s receptivity to mobile notifications. In: Presented at the CHI 2016 CHI Conference on Human Factors in Computing Systems (2016)Google Scholar
  32. 32.
    Müller, H., et al.: Understanding tablet use: A multi-method exploration. In: Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services, pp. 1–10. ACM, New York (2012)Google Scholar
  33. 33.
    Nacenta, M.: Cross-display object movement in multi-display environments. Ph.D. thesis, University of Saskatchewan (2009). http://library2.usask.ca/theses/available/etd-01062010123426
  34. 34.
    Marmasse, N., Schmandt, C., Spectre, D.: WatchMe: Communication and awareness between members of a closely-knit group. In: Davies, N., Mynatt, Elizabeth D., Siio, I. (eds.) UbiComp 2004. LNCS, vol. 3205, pp. 214–231. Springer, Heidelberg (2004). doi: 10.1007/978-3-540-30119-6_13 CrossRefGoogle Scholar
  35. 35.
    Nebeling, M., et al.: WearWrite: Orchestrating the crowd to complete complex tasks from wearables. In: Presented at the UIST 2015 Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (2015)Google Scholar
  36. 36.
    Oakley, I., Lee, D.: Interaction on the edge: offset sensing for small devices. In: Presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2014)Google Scholar
  37. 37.
    Oulasvirta, A., Sumari, L.: Mobile kits and laptop trays: Managing multiple devices in mobile information work. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1127–1136 ACM, New York (2007)Google Scholar
  38. 38.
    Pizza, S., et al.: Smartwatch in vivo. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5456–5469. ACM, New York (2016)Google Scholar
  39. 39.
    Rawassizadeh, R., et al.: Wearables: Has the age of smartwatches finally arrived? Commun. ACM 58(1), 45–47 (2014)CrossRefGoogle Scholar
  40. 40.
    Santosa, S., Wigdor, D.: A field study of multi-device workflows in distributed workspaces. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 63–72. ACM, New York (2013)Google Scholar
  41. 41.
    Schildbach, B., Rukzio, E.: Investigating selection and reading performance on a mobile phone while walking. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 93–102. ACM (2010)Google Scholar
  42. 42.
    Schirra, S., Bentley, F.R.: It’s kind of like an extra screen for my phone: Understanding everyday uses of consumer smart watches. In: Presented at the Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (2015)Google Scholar
  43. 43.
    Swan, M.: Sensor mania! The internet of things, wearable computing, objective metrics, and the quantified self 2.0. J. Sensor Actuator Netw. 1(3), 217–253 (2012)CrossRefGoogle Scholar
  44. 44.
    Terrenghi, L., et al.: A taxonomy for and analysis of multi-person-display ecosystems. Pers. Ubiquit. Comput. 13(8), 583–598 (2009)CrossRefGoogle Scholar
  45. 45.
    Uzun, E., et al.: Pairing devices for social interactions: A comparative usability evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2315–2324. ACM, New York (2011)Google Scholar
  46. 46.
    Xiao, R., et al.: Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click. In: Presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2014)Google Scholar
  47. 47.
    Gartner Says Worldwide Wearable Devices Sales to Grow 18.4 Percent in 2016. Gartner (2016)Google Scholar
  48. 48.
    Media alert: Apple shipped two-thirds of all smart watches in 2015. Canalys (2016)Google Scholar
  49. 49.
    Top 10 Smartwatch Companies 2014 (Sales). Smartwatch GroupGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Mobile Life CentreStockholm UniversityStockholmSweden

Personalised recommendations