Abstract
Human-robot interfaces can be challenging and tiresome because of misalignments in the control and view relationships. The human user must mentally transform (e.g., rotate or translate) desired robot actions to required inputs at the interface. These mental transformations can increase task difficulty and decrease task performance. This chapter discusses how to improve task performance by decreasing the mental transformations in a human-robot interface. It presents a mathematical framework, reviews relevant background, analyzes both single and multiple camera-display interfaces, and presents the implementation of a mentally efficient interface.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Anderson, J.R.: Review: perception-based knowledge representations. In: Cognitive Psychology and Its Implications, 4th edn. Freeman, New York (1995)
Arthur, K.W.: 3D task performance using head-coupled stereo displays. M.S. thesis, University of British Columbia (1993)
Barfield, W., Sandford, J., Foley, J.: The mental rotation and perceived realism of computer-generated three-dimensional images. International Journal of Man-Machine Studies 29(6), 669–684 (1988)
Cao, C.G.L.: Augmented reality displays for endoscopic orientation and navigation. In: CHI 2000 extended abstracts on Human Factors in Computing Systems (2000)
Chiruvolu, R., Hwang, V.S., Sheridan, T.B.: Virtual display aids for teleoperation. In: SPIE – The International Society for Optical Engineering (1992)
DeJong, B.P.: Improving Teleoperation Interfaces: Creation of a Testbed and Thinking Inside the Box. M.S. thesis, Northwestern University (2003)
DeJong, B.P., Colgate, J.E., Peshkin, M.A.: Improving teleoperation: reducing mental rotations and translations. In: IEEE International Conference on Robotics and Automation, New Orleans (2004)
DeJong, B.P., Colgate, J.E., Peshkin, M.A.: Improving teleoperation: reducing mental rotations and translations. American Nuclear Society, Gainesville, FL (2004)
DeJong, B.P., Faulring, E.L., Colgate, J.E., Peshkin, M.A.: Lessons learned from a novel teleoperation testbed. Industrial Robot 33(3), 187–193 (2006)
Department of Energy: Dual Arm Work Platform Teleoperated Robotics System, DOE/EM-0389 (1998)
DiDomenico, A.T.: An investigation on subjective assessments of workload and postural stability under conditions of joint mental and physical demands. Ph.D. thesis, Virginia Polytechnic Institute and State University (2003)
Faulring, E.L., Colgate, J.E., Peshkin, M.A.: The cobotic hand controller: design, control and performance of a novel haptic display. The International Journal of Robotics Research 25, 1099–1119 (2006)
Flanagan, J.R., Rao, A.K.: Trajectory adaption to a nonlinear visuomotor transformation: evidence of motion planning in visually perceived space. Journal of Neurophysiology 74(5), 2174–2178 (1995)
Guthart, G.S., Salisbury, J.K.: The intuitive telesurgery system: overview and application. In: IEEE International Conference on Robotics and Automation (2000)
Hancock, P.A., Chignell, M.H.: Mental workload dynamics in adaptive interface design. IEEE Transactions on Systems, Man, and Cybernetics 18(4), 647–658 (1988)
Hiatt, L.M., Simmons, R.: Coordinate frames in robotic teleoperation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (2006)
Johnson, C.A., Adams, J.A., Kawamura, K.: Evaluation of an enhanced human-robot interface. In: IEEE International Conference on Systems, Man, and Cybernetics (2003)
Kosslyn, S.M.: Image and Mind. Harvard University Press, Cambridge (1980)
Krakauer, J.W., Pine, Z.M., Ghilardi, M.F., Ghez, C.: Learning of visuomotor transformations for vectorial planning of reaching trajectories. Journal of Neuroscience 20(23), 8916–8924 (2000)
Lamb, P., Owen, D.: Human performance in space telerobotic manipulation. In: ACM Symposium on Virtual Reality Software and Technology (2005)
Mason, M.T.: Mechanics of Robotic Manipulation. MIT Press, Cambridge (2001)
Menchaca-Brandan, M.A., Liu, A.M., Oman, C.M., Natapoff, A.: Influence of perspective-taking and mental rotation abilities in space teleoperation. In: ACM/IEEE International Conference on Human-Robot Interaction (2007)
Miyake, Y.: Coordinate systems for hand control. Ph.D. thesis, University of California (1982)
Murphy, R.R.: Human-robot interaction in rescue robotics. IEEE Transactions on Systems, Man, and Cybernetics 34(2) (2004)
Nawab, A., Chintamani, K., Ellis, D., Auner, G., Pandya, A.: Joystick mapped augmented reality cues for end-effector controlled tele-operated robots. In: Virtual Reality Conference (2007)
Nielsen, C.W., Goodrich, M.A., Ricks, R.W.: Ecological interfaces for improving mobile robot teleoperation. IEEE Transactions of Robotics and Automation 23(5) (2007)
Noakes, M.W., Love, L.J., Lloyd, P.D.: Telerobotic planning and control for DOE D and D operations. In: IEEE International Conference on Robotics and Automation (2002)
Park, Y.S., Ewing, T.F., Yule, T.J., Colgate, E., Peshkin, M.: Enhanced teleoperation exhibiting tele-autonomy and tele-collaboration. Department of Energy, ANL/TD/CP-107730 (2002)
Park, Y.S., Kang, H., Ewing, T.F., Faulring, E., Colgate, J.E., Peshkin, M.: Enhanced teleoperation for D&D. In: IEEE International Conference on Robotics and Automation, New Orleans (2004)
Pylyshyn, Z.W.: The rate of ‘mental rotation’ of images: a test of a holistic analogue hypothesis. Memory and Cognition 7, 19–28 (1979)
Sanders, M.S., McCormick, E.J.: Human Factors in Engineering and Design, 7th edn. McGraw-Hill, New York (1993)
Schvaneveldt, R.W., Gomez, R.L., Reid, G.B.: Modeling mental workload. Cognitive Technology 3(1) (1998)
Shepard, R.N., Metzler, J.: Mental rotation of three-dimensional objects. Science 171, 701–703 (1971)
Sheridan, T.B.: Telerobotics, Automation, and Human Supervisory Control. MIT Press, Cambridge (1992)
Thompson, R.L.: Integration of visual and haptic feedback for teleoperation. Ph.D. thesis, University of Oxford (2001)
Tyler, W.: Induced stereo movement. Vision Research 14, 609–613 (1974)
Weng, J., Cohen, P., Herniou, M.: Camera calibration with distortion models and accuracy evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence 14(10) (1992)
Wexler, M., Kosslyn, S.M., Berthoz, A.: Motor processes in mental rotation. Cognition 68, 77–94 (1998)
Wraga, M., Creem, S.H., Proffitt, D.R.: The influence of spatial reference frames on imagined object and viewer rotations. Acta Psychologica 102, 247–264 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Netherlands
About this chapter
Cite this chapter
DeJong, B.P., Colgate, J.E., Peshkin, M.A. (2011). Mental Transformations in Human-Robot Interaction. In: Wang, X. (eds) Mixed Reality and Human-Robot Interaction. Intelligent Systems, Control and Automation: Science and Engineering, vol 1010. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-0582-1_3
Download citation
DOI: https://doi.org/10.1007/978-94-007-0582-1_3
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-0581-4
Online ISBN: 978-94-007-0582-1
eBook Packages: EngineeringEngineering (R0)