Abstract
Virtual manufacturing environments need complex and accurate 3D human-computer interaction. One main problem of current virtual environments (VEs) is the heavy overloads of the users on both cognitive and motor operational aspects. This paper investigated multimodal intent delivery and intent inferring in virtual environments. Eye gazing modality is added into virtual assembly system. Typical intents expressed by dual hands and eye gazing modalities are designed. The reliability and accuracy of eye gazing modality is examined through experiments. The experiments showed that eye gazing and hand multimodal cooperation has a great potential to enhance the naturalness and efficiency of human-computer interaction (HCI).
Chapter PDF
Similar content being viewed by others
Keywords
References
Bolt, R.A.: The Human Interface. Lifetime Learning Press, California (1984)
Argue, R., Boardman, M., Doyle, J., Hickey, G.: Building a Low-Cost to Track Eye Movement. Faculty of Computer Science, Dalhousie University (December 9, 2004)
Guestrin, D., Eizenman, M.: General Theory of Remote Gaze Estimation Using the Pupil Center and Corneal Reflections. IEEE Transaction on Biomedical Enginering 53(6), 1124–1133 (2006)
Chen, M., Luo, J., Dong, S.: Task-Oriented Synergistic Multimodality. In: Proceedings of the First Interactional Conference on Multimodal Interface(ICMI 1996), pp. 30–33. Tsinghua University Press, Beijing (1996)
Lin, Y., Chen, M., Luo, J., et al.: An Architecture for Multimodal Multi-Agent Interactive System. In: Proceedings for Interactional Conference on CAD/CG 1997. Interactional Academic Press, Beijing (1997)
Ford, N.: Cognitive Styles and Virtual Environments. Journal of the American Society for Information Science (April 2000)
Dong, S.H., Chen, M., Luo, J.: The Model, Method and Instance of Multimodal User Interface. Universitatis Pekinences 34(2-3) (April 1998)
Fang, Z.G.: Visual Line Tracking Technology and Its Application in Multimodal User Interface. Systems Engineering and Electronics
Jacob, R.J.K.: What You Look at is What You Get: Eye Movement-Based Interaction Techniques. In: CHI 1990 Poceeding. ACM (1990)
Salvucci, D.D., Anderson, J.R.: Intelligent gaze-added ingerface. In: CHI 2000 Conference Proceedings. ACM Press, Netherlands (2000)
Kumar, M., Paepche, A., Winograd, T.: EyePoint Practical Pointing and Selection Using Gaze and Keyboard. In: CHI 2007, San Jose, CA, USA, pp. 421–430. ACM Press (2007)
Tanriverdi, V., Jacob, J.K.: Interaction with eye movements in virtual environments. In: CHI 2000 Conference Proceedings. ACM Press, Netherlands (2000)
Barfield, W., Furness, T.A.: Virtual Environments and Advanced Interface Design. Oxford University Press, Oxford (1995)
Zhu, Z., Ji, Q.: Eye Gaze Tracking Under Natural Head Movements. In: Proceeding of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR (2005)
Kumar, M., Klingner, J., Puranik, R., Winograd, T., Paepcke, A.: Improving the Accuracy of Gaze Input for Interaction. In: ETRA 2008 - Proceedings of the Eye Tracking Research and Application Symposium, vol. 26-28, pp. 65–68 (March 2008)
Carpenter, R.H.S.: Movements of the Eyes. Pion Ltd. (1988)
Omran, M.G.H., Engelbrecht, A.P., Salman, A.: An Overview of Clustering Methods. Intelligent Data Analysis 11(6), 538–605 (2007)
Guha, S., Meyerson, A., Mishra, N., Motwani, R., O’ Callaghan, L.: Clustering data streams: Theory and Practice. IEEE Transaction on Knowledge and Data Enginerring 15(3), 515–528 (2003)
Beymer, D., Flickner, M.: Eye gaze tracking using an active stereo head. In: Proceedings of the Computer Vision and Pattern Recognition, Madison, pp. 451–458 (2003)
Morimoto, H., Mimica, M.: Eye gaze tracking techniques for interactive applications. Computer Vision Image Understand, Special Issue on Eye Detection and Tracking 98, 4–24 (2005)
Matsumoto, Y., Zelinsky, A.: An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement. In: Proc. 4th IEEE Int. Conf. Automatic Face & Gesture Recognition, pp. 499–504 (2000)
Shih, S.W., Liu, J.: A Novel approach to 3-d Gaze Tracking using Stereo Cameras. IEEE Trans. Syst., Man and Cybern., Part B, No 1, 234–245 (2004)
Duchowski, A.T.: Eye Tracking Methodology: Theory and Practice. Springer (2002)
Cheng, C., Jingjing, D.: Research and Realization on Real-time Linear Prediction Algorithm for Desktop Eye-Tracking. Acta Electronic Sinica 37(4A) (April 2009)
Slater, M., Steed, A., Chrysanthou, Y.: Computer Graphics and Virtual Environments: From Realism to Real-time. Addison Wesley (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Guo, W., Cheng, C., Cheng, M., Jiang, Y., Tang, H. (2013). Intent Capturing through Multimodal Inputs. In: Kurosu, M. (eds) Human-Computer Interaction. Interaction Modalities and Techniques. HCI 2013. Lecture Notes in Computer Science, vol 8007. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39330-3_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-39330-3_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39329-7
Online ISBN: 978-3-642-39330-3
eBook Packages: Computer ScienceComputer Science (R0)