Abstract
In this paper we proposea multimodal text entry method for touchscreen smartphones, where standard Tap modality can be used in combination with Pitch and Roll movements that change the orientation of the mobile device. Data from the built-in orientation sensors are used as a basis for commands that support character layout changing. Tilting the device in the appropriate direction will cause visual enlargement of the corresponding half of the current keyboard layout, thus enabling easier character selection, and solely sensor-based text entry. The prototype implementation of the proposed interaction method is analyzed and evaluated via usability testing experiments, with special focus on efficiency of text entry. As the proposed method is also applicable on touchscreen tablets, the form factor of mobile devices is reviewed with respect to text entry performance both of supported interaction modalities (tilt-only and tilt-and-tap) and of possible device orientations (portrait and landscape).
Chapter PDF
Similar content being viewed by others
References
Findlater, L., Wobbrock, J.O.: From Plastic to Pixels: In Search of Touch-Typing Touchscreen Keyboards. ACM Interactions XIX 3, 44–49 (2012)
Stephanidis, C.: Editorial. Universal Access in the Information Society 1(1), 1–3 (2001)
Shneiderman, B.: Universal Usability: Pushing Human-Computer Interaction Research to Empower Every Citizen. Communications ACM 43(5), 85–91 (2000)
Rekimoto, J.: Tilting Operations for Small Screen Interfaces. In: Proc. 9th ACM Symp. User Interface Software and Technology (UIST 1996), pp. 167–168. ACM Press, New York (1996)
Hinckley, K., Pierce, J., Sinclair, M., Horvitz, E.: Sensing Techniques for Mobile Interaction. In: Proc. 13th ACM Symp. User Interface Software and Technology (UIST 2000), pp. 91–100. ACM Press, New York (2000)
Sazawal, V., Want, R., Borriello, G.: The Unigesture Approach. In: Proc. 4th Int’l Symp. Mobile HCI (MobileHCI 2002), pp. 256–270. Springer, London (2002)
Partridge, K., Chatterjee, S., Sazawal, V., Borriello, G., Want, R.: TiltType: Accelerometer-Supported Text Entry for Very Small Devices. In: Proc. 15th ACM Symp. User Interface Software and Technology (UIST 2002), pp. 201–204. ACM Press, New York (2002)
Wigdor, D., Balakrishnan, R.: TiltText: Using Tilt for Text Input to Mobile Phones. In: Proc. 16th ACM Symp. User Interface Software and Technology (UIST 2003), pp. 81–90. ACM Press, New York (2003)
Rahman, M., Gustafson, S., Irani, P., Subramanian, S.: Tilt Techniques: Investigating the Dexterity of Wrist-based Input. In: Proc. 27th Int’l Conf. Human Factors in Computing Systems (CHI 2009), pp. 1943–1952. ACM Press, New York (2009)
Dearman, D., Karlson, A., Meyers, B., Bederson, B.: Multi-Modal Text Entry and Selection on a Mobile Device. In: Proc. Graphics Interface 2010 (GI 2010), pp. 19–26. Canadian Information Processing Society, Toronto (2010)
Jones, E., Alexander, J., Andreou, A., Irani, P., Subramanian, S.: GesText: Accelerometer-Based Gestural Text-Entry Systems. In: Proc. 28th Int’l Conf. Human Factors in Computing Systems (CHI 2010), pp. 2173–2182. ACM Press, New York (2010)
Goel, M., Findlater, L., Wobbrock, J.: WalkType: Using Accelerometer Data to Accommodate Situational Impairments in Mobile Touch Screen Text Entry. In: Proc. 2012 ACM Conf. Human Factors in Computing Systems (CHI 2012), pp. 2687–2696. ACM Press, New York (2012)
Inference Group: The Dasher Project, http://www.inference.phy.cam.ac.uk/dasher/
MacKenzie, I.S., Soukoreff, R.W.: Phrase Sets for Evaluating Text Entry Techniques. In: Proc. Extended Abstracts on Human Factors in Computing Systems (CHI EA 2003), pp. 754–755. ACM Press, New York (2003)
Soukoreff, R.W., MacKenzie, I.S.: Measuring Errors in Text Entry Tasks: An Application of the Levenshtein String Distance Statistic. In: Proc. Extended Abstracts on Human Factors in Computing Systems (CHI EA 2001), pp. 319–320. ACM Press, New York (2001)
MacKenzie, I.S.: KSPC (Keystrokes per Character) as a Characteristic of Text Entry Techniques. In: Proc. 4th Int’l Symp. Mobile HCI (MobileHCI 2002), pp. 195–210. Springer, London (2002)
Soukoreff, R.W., MacKenzie, I.S.: Metrics for Text Entry Research: An Evaluation of MSD and KSPC, and a New Unified Error Metric. In: Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI 2003), pp. 113–120. ACM Press, New York (2003)
Soukoreff, R.W., MacKenzie, I.S.: Recent Developments in Text-Entry Error Rate Measurement. In: Proc. Extended Abstracts on Human Factors in Computing Systems (CHI EA 2004), pp. 1425–1428. ACM Press, New York (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ljubic, S., Kukec, M., Glavinic, V. (2013). Tilt-Based Support for Multimodal Text Entry on Touchscreen Smartphones: Using Pitch and Roll. In: Stephanidis, C., Antona, M. (eds) Universal Access in Human-Computer Interaction. Applications and Services for Quality of Life. UAHCI 2013. Lecture Notes in Computer Science, vol 8011. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39194-1_75
Download citation
DOI: https://doi.org/10.1007/978-3-642-39194-1_75
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39193-4
Online ISBN: 978-3-642-39194-1
eBook Packages: Computer ScienceComputer Science (R0)