Abstract
Much research has been done to support remote collaboration on physical tasks. However, the focus of the research has been mainly on system and interface design and their impact on collaboration. Relatively less attention has been paid to investigating how network performance can affect user experience and task performance. In this paper, we present a preliminary user study on this issue in which participants were asked to work collaboratively in pair using a remote mobile tele-assistance system we developed. In this study, five network scenarios were examined and network performance (QoS) was measured using four metrics including delay, jitter, bandwidth and packet loss. User experience (QoE) was measured using both objective and subjective metrics. The formal included time taken and number of instructions repeated for task performance while the latter included user ratings of quality of audio experience, quality of video experience and overall quality of experience. The results indicated that the packet loss rate in QoS is the biggest contributor to loss in QoE. We also discuss implications of the study and possible directions of future work.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Fluckiger, F.: Understanding Networked Multimedia. Prentice Hall (1995)
Szuprowicz, B.: Multimedia Networking. McGraw-Hill Inc. (1995)
International Telecommunications Union, Definitions of terms related to quality of service. ITU Standardizatioin Sector (September 2008)
Microsoft, Network Bandwidth Requirements for Media Traffic, Lync TechNet Library (2013)
Sarwar, G., et al.: On the Quality of VoIP with DCCP for Satellite Communications. Internationl Journal of Satellite Communications (2000)
Chen, Y., Farley, T., Ye, N.: QoS Requirements of Network Applications on the Internet. Department of Industrial Engineering, Arizona State University (2004)
Fussell, S., Setlock, L., Yang, J., Ou, J., Mauer, E., Kramer, A.: Gestures over video streams to support remote collaboration on physical tasks. In: Hum.-Comput. Interact., vol. 19(3), pp. 273–309 (September 2004)
Gergle, D., Kraut, R., Fussell, S.: The impact of delayed visual feedback on collaborative performance. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2006), pp. 1303–1312 (2006)
Huang, W., Alem, L.: HandsinAir: a wearable system for remote collaboration on physical tasks. In: Proceedings of the 2013 Conference on Computer Supported Cooperative Work Companion (CSCW 2013), pp. 153–156 (2013)
Huang, W., Alem, L.: Supporting hand gestures in mobile remote collaboration: a usability evaluation. In: Proceedings of the 25th BCS Conference on Human-Computer Interaction (BCS-HCI 2011), pp. 211–216 (2011)
Kuzuoka, H., Yamazaki, K., Yamazaki, A., Kosaka, J., Suga, Y., Heath, C.: Dual ecologies of robot as communication media: thoughts on coordinating orientations and projectability. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2004), pp. 183–190 (2004)
Kuzuoka, H., Kosaka, J., Yamazaki, K., Suga, Y., Yamazaki, A., Luff, P., Heath, C.: Mediating dual ecologies. In: Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW 2004), pp. 477–486 (2004)
Kuzuoka, H.: Spatial workspace collaboration: a SharedView video support system for remote collaboration capability. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1992), pp. 533–540 (1992)
Kirk, D., Rodden, T., Fraser, D.: Turn it this way: grounding collaborative action with remote gestures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2007), pp. 1039–1048 (2007)
Tecchia, F., Alem, L., Huang, W.: 3D helping hands: a gesture based MR system for remote collaboration. In: Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI 2012), pp. 323–328 (2012)
Yamashita, N., Kaji, K., Kuzuoka, H., Hirata, K.: Improving visibility of remote gestures in distributed tabletop collaboration. In: Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (CSCW 2011), pp. 95–104 (2011)
Rajkumar, R., et al.: A resource allocation model for QoS management. In: IEEE Real Time Systems Symposium (1997)
Mohan, S., Kapoor, R., Mohanty, B.: Latency in HSPA Data Networks. Qualcomm Research Papers (2003)
Wu, W., Arefin, A., Rivas, R., Nahrstedt, K., Sheppard, R., Yang, Z.: Quality of experience in distributed interactive multimedia environments: toward a theoretical framework. In: Proceedings of the 17th ACM International Conference on Multimedia (MM 2009), pp. 481–490 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Donovan, A., Alem, L., Huang, W., Liu, R., Hedley, M. (2014). Understanding How Network Performance Affects User Experience of Remote Guidance. In: Baloian, N., Burstein, F., Ogata, H., Santoro, F., Zurita, G. (eds) Collaboration and Technology. CRIWG 2014. Lecture Notes in Computer Science, vol 8658. Springer, Cham. https://doi.org/10.1007/978-3-319-10166-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-10166-8_1
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10165-1
Online ISBN: 978-3-319-10166-8
eBook Packages: Computer ScienceComputer Science (R0)