Abstract
We aim to better inform the scientific community regarding test and evaluation techniques for validating devices that will potentially be used by individuals interfacing with autonomous robotic teammates (particularly, members of the U.S. Military). Testing within immersive virtual environments (IVRs) similar to those experienced in military operations will be discussed with focus on the use of a commercial gaming engine for task development. Highlights of using commercial gaming engines will be illustrated throughout the paper to emphasize their utility for evaluating future technologies with attention given to testing efficiency and ecological validity. The study of interactions with simulated agents and future communication devices will be described in the context of the Robotics Collaborative Technology Alliance (RCTA) research program.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yanco, H.A., Drury, J.L.: Rescuing interfaces: a multi-year study of human-robot interaction at the AAAI robot rescue competition. Auton. Robots 22(4), 333–352 (2007)
Chen, J.Y.C., Haas, E.C., Barnes, M.J.: Human performance issues and user interface design for teleoperated robots. IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 37(6), 1231–1245 (2007)
Perzanowski, D., Schultz, A.C., Adams, W., Marsh, E., Bugajska, M.: Building a multimodal human-robot interface. IEEE Intell. Syst. 16(1), 16–21 (2001)
Evans III, A.W., Hoeft, R.M., Rehfeld, S.A., Feldman, M., Curtis, M., Fincannon, T., Ottlinger, J., Jentsch, F.: Advancing robotics research through the use of a scale MOUT facility. Proc. Hum. Factors Ergon. Soc. Ann. Meet. 49(6), 742–746 (2005)
Rizzo, A., Buckwalter, J.: Virtual reality and cognitive assessment and rehabilitation: the state of the art. Stud. Health Technol. Inf. 44, 123–145 (1997)
Deterding, S.: Gamification: designing for motivation. Interactions 19(4), 14–17 (2012)
Denny, P.: The effect of virtual achievements on student engagement. In: Proceedings of CHI 2013: Changing Perspectives, pp. 763–772 (2013)
Landers, R.N., Armstrong, M.B.: Enhancing instructional outcomes with gamification: an empirical test of the technology-enhanced training effectiveness model. Comput. Hum. Behav. 71, 499–507 (2017)
Michael, D.R., Chen, S.: Serious games: games that educate, train, and inform. Muska & Lipman/Premier-Trade. Thomson Course Technology, Boston (2006)
Abt, C.C.: Serious Games. University Press of America, Boston (1987)
Landers, R.N.: Developing a theory of gamified learning: linking serious games and gamification of learning. Simul. Gaming 45(6), 752–768 (2014)
Roth, S.: Serious gamification: on the redesign of a popular paradox. Games Cult. 12(1), 100–111 (2017)
Connolly, T.M., Boyle, E.A., MacArthur, E., Hainey, T., Boyle, J.M.: A systematic literature review of empirical evidence on computer games and serious games. Comput. Educ. 59(2), 661–686 (2012)
Boyle, E., Connolly, T.M., Hainey, T.: The role of psychology in understanding the impact of computer games. Entertain. Comput. 2(2), 69–74 (2011)
Heeter, C.: Being there: the subjective experience of presence. Presence: Teleoper. Virtual Environ. 1(2), 262–271 (1992)
Snow, M.P., Williges, R.C.: Empirical modeling of perceived presence in virtual environments using sequential experimentation techniques. In: Proceedings of the Human Factors and Ergonomics Society, 41st Annual Meeting, pp. 1224–1228 (1997)
Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments (Tech. Rep. No. 1014). U.S. Army Research Institute, Washington, DC (1994)
Barfield, W., Sheridan, T., Zeltzer, D., Slater, M.: Presence and performance within virtual environments. In: Barfield, W., Furness, T.A. (eds.) Virtual Environments and Advanced Interface Design, pp. 473–513 (1995)
Barfield, W., Weghorst, S.: The sense of presence within virtual environments: a conceptual framework. In: Salvendy, G., Smith, M. (eds.) Human–Computer Interaction: Software and Hardware Interfaces, pp. 699–704 (1993)
Steuer, J.: Defining virtual reality: dimensions determining telepresence. J. Commun. 42, 73–93 (1992)
Bowman, D., McMahan, R.: Virtual reality: how much immersion is enough? Computer 40, 36–43 (2007)
McMahan, R.P., Bowman, D.A., Zielinski, D.J., Brady, R.B.: Evaluating display fidelity and interaction fidelity in a virtual reality game. IEEE Trans. Vis. Comput. Graph. 18, 626–633 (2012)
Slater, M.: Place illusion and plausibility can lead to realistics behaviour in immersive virtual environments. Philos. Trans. R. Soc. B 364, 3549–3557 (2009)
Endsley, M.R.: Design and evaluation for situation awareness enhancement. Proc. Hum. Factors Soc. Ann. Meet. 32, 97–101 (1988)
Moray, N.: Mental Workload: Its Theory and Measurement. Plenum, New York (1979)
Wickens, C.D.: Multiple resources and mental workload. Hum. Factors 50, 449–455 (2008)
Acknowledgments
The research reported in this document was performed in connection with Contract Number W911NF-10- 2-0016 with the U.S. Army Research Laboratory. The views and conclusions contained in this document are those of the authors and should not be interpreted as presenting the official policies or position, either expressed or implied, of the U.S. Army Research Laboratory, or the U.S. Government unless so designated by other authorized documents. Citation of manufacturers or trade names does not constitute an official endorsement or approval of the use thereof. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. Support for this endeavor was additionally provided by the University of Central Florida’s Office of Research and Commercialization in the form of financial assistance via Mr. Bendell’s ORC fellowship.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Vasquez, G., Bendell, R., Talone, A., Nguyen, B., Jentsch, F. (2019). The Use of Immersive Virtual Reality for the Test and Evaluation of Interactions with Simulated Agents. In: Cassenti, D. (eds) Advances in Human Factors in Simulation and Modeling. AHFE 2018. Advances in Intelligent Systems and Computing, vol 780. Springer, Cham. https://doi.org/10.1007/978-3-319-94223-0_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-94223-0_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94222-3
Online ISBN: 978-3-319-94223-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)