Abstract
When developing a computer (mobile) game, testing the game is an important task and takes a large share of the development cost. So far, testing a game’s functional features relies mainly on human testers, who personally plays the game, and is thus labor intensive. This paper proposes a method that automates game testing. Since games are usually built on top of game frameworks, the idea is to enhance a game framework with a testing layer, which can execute (playback) test scripts that perform user events and assert the correctness of the game. We design an HTML5 game framework with such a support. In addition, a case study is performed to compare the testing cost of three different methods: writing a test script directly, recording a test script, and testing the game directly by a human tester. The results showed that when repeated testings are necessary, an automatic testing (either writing or recording test scripts) can reduce human cost. Among these three testing methods, recording scripts was the most favored method.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Robot Framework. http://robotframework.org/. Cited 1 Feb 2015
HP. Unified functional testing (UFT). http://www8.hp.com/us/en/software-solutions/unified-functional-automated-testing/. Cited 1 Feb 2015
Selenium. Selenium. http://www.seleniumhq.org/. Cited 1 Feb 2015
Microsoft. Verifying code by using UI automation. https://msdn.microsoft.com/en-us/library/dd286726.aspx. Cited 1 Feb 2015
Google. uiautomator. http://developer.android.com/tools/help/uiautomator/index.html. Cited 1 Feb 2015
Memon, A.M., Pollack, M.E., Soffa, M.L.: Hierarchical GUI test case generation using automated planning. IEEE Trans. Softw. Eng. 27(2), 144–155 (2001)
Chen, W.-K., Shen, Z.-W., Tsai, T.-H.: Integration of specification-based and CR-based approaches for GUI testing. J. Inf. Sci. Eng. 24(5), 1293–1307 (2008)
Cocos2D. Cocos2D. http://www.cocos2d-x.org/. Cited 1 Feb 2015
Unity. Unity. http://unity3d.com/. Cited 1 Feb 2015
QUnit. QUnit. http://qunitjs.com/. Cited 1 Feb 2015
Kasurinen, J., Smolander, K.: What do game developers test in their products? In: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, Ser. ESEM’14, pp. 1:1–1:10 (2014)
Zhao, H., Sun, J., Hu, G.: Study of methodology of testing mobile games based on TTCN-3. In: 10th ACIS International Conference on Software Engineering, Artificial Intelligences, Networking and Parallel/Distributed Computing (SNPD’09), pp. 579–584 (2009)
Cho, C.-S., Sohn, K.-M., Park, C.-J., Kang, J.-H.: Online game testing using scenario-based control of massive virtual users. In: The 12th International Conference on Advanced Communication Technology (ICACT 2010), vol. 2, pp. 1676–1680 (2010)
Cho, C.-S., Lee, D.-C., Sohn, K.-M., Park, C.-J., Kang, J.-H.: Scenario-based approach for blackbox load testing of online game servers. In: 2010 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, pp. 259–265 (2010)
Schaefer, C., Hyunsook, D., Slator, B.M.: Crushinator: a framework towards game-independent testing. In: IEEE/ACM 28th International Conference on Automated Software Engineering (ASE 2013), pp. 726–729 (2013)
Diah, N.M., Ismail, M., Ahmad, S., Dahari, M.K.M.: Usability testing for educational computer game using observation method. In: 2010 International Conference on Information Retrieval Knowledge Management, pp. 157–161 (2010)
HTML5-benchmark HTML5-benchmark. http://html5-benchmark.com/. Cited 1 Feb 2015
Chen, W.-K., Cheng, Y.C.: Teaching object-oriented programming laboratory with computer game programming. IEEE Trans. Educ. 50(3), 197–203 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Chen, WK., Liu, CH., Chen, PH., Hsu, CS. (2016). A Game Framework Supporting Automatic Functional Testing for Games. In: Lee, R. (eds) Applied Computing & Information Technology. Studies in Computational Intelligence, vol 619. Springer, Cham. https://doi.org/10.1007/978-3-319-26396-0_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-26396-0_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26394-6
Online ISBN: 978-3-319-26396-0
eBook Packages: EngineeringEngineering (R0)