Abstract
Our goal is to deliver unobtrusive task migration, typically between a desktop computer and a mobile device. We propose to overlay an aesthetically acceptable marker field across (a part of) the monitor screen. This marker field must be easily detectable even by a low-end ultramobile device, unobtrusive to the user, and easy to mix in the natural screen image. We show that Uniform Marker Fields are a good choice for this task and propose a methodology for inserting them into the screen image. The experimental results show that our solution provides reliable task migration on a video stream in interactive frame rates (~30 FPS marker detection, 340 ms whole processing time including wireless communication, HTC Desire from 2010). This substantially outperforms the existing solutions based on natural keypoints (~7 sec processing). Our user tests also led to selection and design of appropriate marker fields and their mixing parameters.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bales, E., Sohn, T., Setlur, V.: Planning, apps, and the high-end smartphone: exploring the landscape of modern cross-device reaccess. In: Lyons, K., Hightower, J., Huang, E.M. (eds.) Pervasive 2011. LNCS, vol. 6696, pp. 1–18. Springer, Heidelberg (2011)
Karlson, A.K., Iqbal, S.T., Meyers, B., Ramos, G., Lee, K., Tang, J.C.: Mobile taskflow in context: a screenshot study of smartphone usage. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI 2010, pp. 2009–2018. ACM, New York (2010)
Dearman, D., Pierce, J.S.: It’s on my other computer!: computing with multiple devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2008, pp. 767–776. ACM, New York (2008)
Harding, M., Storz, O., Davies, N., Friday, A.: Planning ahead: techniques for simplifying mobile service use. In: Proceedings of the 10th Workshop on Mobile Computing Systems and Applications, HotMobile 2009, pp. 1–13. ACM, New York (2009)
Bardram, E.: Activity-based computing: support for mobility and collaboration in ubiquitous computing. Personal Ubiquitous Comput. 9(5), 312–322 (2005)
Church, K., Smyth, B.: Understanding mobile information needs. In: Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services, MobileHCI 2008, pp. 493–494. ACM, New York (2008)
Pierce, J.S., Nichols, J.: An infrastructure for extending applications’ user experiences across multiple personal devices. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, UIST 2008, pp. 101–110. ACM, New York (2008)
Liu, Q., McEvoy, P., Lai, C.-J.: Mobile camera supported document redirection. In: Proceedings of the 14th Annual ACM International Conference on Multimedia, MULTIMEDIA 2006, pp. 791–792. ACM, New York (2006)
Boring, S., Altendorfer, M., Broll, G., Hilliges, O., Butz, A.: Shoot & copy: phonecam-based information transfer from public displays onto mobile phones. In: Chong, P.H.J., Cheok, A.D. (eds.) Mobility Conference, pp. 24–31. ACM (2007)
Chang, T.H., Li, Y.: Deep shot: a framework for migrating tasks across devices using mobile phone cameras. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 2163–2172. ACM, New York (2011)
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (2008)
Klein, G., Murray, D.: Parallel tracking and mapping for small ar workspaces. In: Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007, pp. 1–10. IEEE Computer Society, Washington, DC (2007)
Woo, G., Lippman, A., Raskar, R.: Vrcodes: Unobtrusive and active visual codes for interaction by exploiting rolling shutter. In: 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 59–64 (2012)
Szentandrasi, I., Zacharias, M., Havel, J., Herout, A., Dubska, M., Kajan, R.: Uniform marker fields: Camera localization by orientable de bruijn tori. In: 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 319–320 (2012)
Herout, A., Szentandrási, I., Zachariáš, M., Dubská, M., Kajan, R.: Five shades of grey for fast and reliable camera pose estimation. In: Proceedings of CVPR (2013)
Schaffalitzky, F., Zisserman, A.: Planar grouping for automatic detection of vanishing lines and points. Image and Vision Computing 18, 647–658 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kajan, R., Szentandrási, I., Herout, A., Zachariáš, M. (2013). On-Screen Marker Fields for Reliable Screen-to-Screen Task Migration. In: Holzinger, A., Ziefle, M., Hitz, M., Debevc, M. (eds) Human Factors in Computing and Informatics. SouthCHI 2013. Lecture Notes in Computer Science, vol 7946. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39062-3_50
Download citation
DOI: https://doi.org/10.1007/978-3-642-39062-3_50
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39061-6
Online ISBN: 978-3-642-39062-3
eBook Packages: Computer ScienceComputer Science (R0)