Abstract
We propose a fast, flexible approach to automatically generating two-dimensional character images for video games. We treat the generation of character images as a two-part machine learning problem. The first task is to generate structured images that represent common attributes of characters as images. The second task is to add details to the structured images that appear to fit with some overall theme for each image. For both tasks, we employ generative adversarial network architectures, with modifications to improve their performance for their respective tasks. The resulting As2-GAN approach generates character images that are as realistic as those generated with the DCGAN approach, and are more consistent in quality and structural resemblance to images from the dataset. The As2-GAN approach also provides image creators with more control over images than typical one-step methods, while being able to generate high quality images using small datasets.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Goodfellow, I.J., et al.: Generative adversarial nets. In: NIPS, vol. 27 (2014)
He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: IEEE International Conference on Computer Vision, pp. 1026–1034 (2015)
Isola, P., Zhu, J.-Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5967–5976 (2016)
Kingma, D.P., Welling, M.: Auto-encoding variational Bayes. CoRR (2013)
Lau, S.: Learning rate schedules and adaptive learning rate methods for deep learning (2017). https://towardsdatascience.com/learning-rate-schedules-and-adaptive-learning-rate-methods-for-deep-learning-2c8f433990d1
Mao, X., Li, Q., Xie, H., Lau, R.Y., Wang, Z., Smolley, S.P.: Least squares generative adversarial networks. In: IEEE International Conference on Computer Vision (2016)
The Pokémon Company. https://www.pokemon.com/
Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. CoRR (2015)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Rosca, M., Lakshminarayanan, B., Warde-Farley, D., Mohamed, S.: Variational approaches for auto-encoding generative adversarial networks. CoRR (2017)
Wang, X., Gupta, A.: Generative image modeling using style and structure adversarial networks. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 318–335. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46493-0_20
Zhu, J.-Y., et al.: Toward multimodal image-to-image translation. In: NIPS (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Mann, M.T., Hamilton, H.J. (2019). Automatic Generation of Video Game Character Images Using Augmented Structure-and-Style Networks. In: Meurs, MJ., Rudzicz, F. (eds) Advances in Artificial Intelligence. Canadian AI 2019. Lecture Notes in Computer Science(), vol 11489. Springer, Cham. https://doi.org/10.1007/978-3-030-18305-9_34
Download citation
DOI: https://doi.org/10.1007/978-3-030-18305-9_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-18304-2
Online ISBN: 978-3-030-18305-9
eBook Packages: Computer ScienceComputer Science (R0)