Abstract
The complex training simulation process often comprises multiple ordered tasks, and the training effects need to be evaluated from single task to multiple combined tasks for credibility assessment. In order to assess the credibility of training simulations, a novel credibility assessment method is proposed from the view of training effectiveness. An integrated credibility assessment framework for training simulations is given primarily involving project process, technical process and information artifacts. Then the single-task training effectiveness evaluation (TEE) method based on paired t-test and the multi-tasks TEE method using cluster analysis are proposed respectively for credibility assessment of complex training simulation. Finally, an application case about TEE for flight training simulation is given to illustrate the proposed method.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Lin, S., Li, W., Ma, P., Yang, M.: A new credibility assessment framework for training simulators. In: 8th International Conference on Computer Modeling and Simulation, pp. 182–186. Association for Computing Machinery, Australia (2017)
Lemmers, A., Roza, M., Voogd, J., van Heck, F.: V&V study of an F-16 familiarization training simulator. In: Fall SIW Proceeding, pp. 13F-SIW-016. SISO, USA (2013)
Department of Defense: Verification Validation and Accreditation (VV&A) Recommended Practice Guide. Technical report. US Department of Defense, USA (1996)
IEEE Computer Society: Verification, validation, and accreditation for distributed interactive simulation, IEEE Std 1278.4 – 1997(R2010). Technical report (2010)
IEEE Computer Society: An overlay to the high level architecture federation development and execution process, IEEE Std 1516. Technical report (2007)
SISO: GM-VV Vol. 3: Reference Manual, SISO-GUIDE-001.3-2013. Technical report (2013)
Roza, M., Lemmers, A., van Heck, F.: Verification and validation of distributed air operation mission training environment. In: AIAA Modeling and Simulation Technology Conference, Boston, USA (2013)
Voogd, J., Roza, M., van Lier, A.: The GM-VV tailored for a naval ship-handling training simulation. In: International Simulation Multi-Conference (2011)
Brade, D., Pohl, S., Youngblood, S.: Preliminary convention report: first combined convention on International VV&A standardization endeavors (CConVV&A), Munich, Germany, October, pp. 20–23 (2005)
Brade, D.: WEAG THALES JP11.20 2005. Final state of the REVVA methodology. Spring SIW 2005, San Diego (2005)
ITOP: General procedure for modeling and simulation verification and validation information exchange. Technical report (2004)
Lynn, M., Michelle, F.: A validation study of driving errors using a driving simulator. Transp. Res. Part F 29, 14–21 (2015)
Geraint, L.H., Thomas, P.C., Pritam, S.: Validation of a pediatric single-port laparoscopic surgery simulator. J. Pediatr. Surg. 50, 1762–1766 (2015)
Ganesh, S., Baichun, L., Amie, M.: Face validation of the virtual electrosurgery skill trainer. Surg. Endosc. 30, 730–738 (2016)
VanderVliet, G.M., Wilkinson, C.H., Roscoe, M.F.: Verification, validation, and accreditation of a flight simulator: the JSHIP experience. In: AIAA Modeling and Simulation Technology Conference, pp. 1–11. AIAA, Canada (2001)
Qiao, J.F., Hu, J.: Validation of discrete event state of simulation model. J. Syst. Simul. 16(4), 794–799 (2004)
Acknowledgements
This research is supported by the National Natural Science Foundation of China (Grant No. 61627810).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Lin, S., Li, W., Niu, S., Ma, P., Yang, M. (2018). A Credibility Assessment Method for Training Simulations from the View of Training Effectiveness. In: Li, L., Hasegawa, K., Tanaka, S. (eds) Methods and Applications for Modeling and Simulation of Complex Systems. AsiaSim 2018. Communications in Computer and Information Science, vol 946. Springer, Singapore. https://doi.org/10.1007/978-981-13-2853-4_25
Download citation
DOI: https://doi.org/10.1007/978-981-13-2853-4_25
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-2852-7
Online ISBN: 978-981-13-2853-4
eBook Packages: Computer ScienceComputer Science (R0)