Generative adversarial network based novelty detection usingminimized reconstruction error

  • Huan-gang Wang
  • Xin Li
  • Tao Zhang


Generative adversarial network (GAN) is the most exciting machine learning breakthrough in recent years, and it trains the learning model by finding the Nash equilibrium of a two-player zero-sum game. GAN is composed of a generator and a discriminator, both trained with the adversarial learning mechanism. In this paper, we introduce and investigate the use of GAN for novelty detection. In training, GAN learns from ordinary data. Then, using previously unknown data, the generator and the discriminator with the designed decision boundaries can both be used to separate novel patterns from ordinary patterns. The proposed GAN-based novelty detection method demonstrates a competitive performance on the MNIST digit database and the Tennessee Eastman (TE) benchmark process compared with the PCA-based novelty detection methods using Hotelling’s T2 and squared prediction error statistics.


Generative adversarial network (GAN) Novelty detection Tennessee Eastman (TE) process 

CLC number



Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Abadi M, Andersen D, 2016. Learning to protect communications with adversarial neural cryptography. Scholar
  2. Arjovsky M, Chintala S, Bottou L, 2017. Wasserstein generative adversarial networks. Int Conf on Machine Learning, p.214–223.Google Scholar
  3. Berthelot D, Schumm T, Metz L, 2017. BEGAN: boundary equilibrium generative adversarial networks. Scholar
  4. Clifton L, Clifton D, Watkinson P, et al., 2011. Identification of patient deterioration in vital-sign data using one-class support vector machines. Federated Conf on Computer Science and Information Systems, p.125–131.Google Scholar
  5. Denton E, Chintala S, Fergus R, et al., 2015. Deep generative image models using a Laplacian pyramid of adversarial networks. Advances in Neural Information Processing Systems, p.1486–1494.Google Scholar
  6. Donahue J, Krähenbühl P, Darrell T, 2016. Adversarial feature learning. Scholar
  7. Downs J, Vogel E, 1993. A plant-wide industrial process control problem. Comput Chem Eng, 17(3):245–255. Scholar
  8. Dumoulin V, Belghazi I, Poole B, et al., 2016. Adversarially learned inference. Scholar
  9. Ge Z, Song Z, 2013. Bagging support vector data description model for batch process monitoring. J Proc Contr, 23(8):1090–1096. Scholar
  10. Ge Z, Yang C, Song Z, 2009. Improved kernel PCA-based monitoring approach for nonlinear processes. Chem Eng Sci, 64(9):2245–2255. Scholar
  11. Ge Z, Gao F, Song Z, 2011. Batch process monitoring based on support vector data description method. J Proc Contr, 21(6):949–959. Scholar
  12. Ge Z, Song Z, Gao F, 2013. Review of recent research on data-based process monitoring. Ind Eng Chem Res, 52(10):3543–3562. Scholar
  13. Ge Z, Demyanov S, Chen Z, et al., 2017. Generative Open-Max for multi-class open set classification. Scholar
  14. Goodfellow I, Pouget-Abadie J, Mirza M, et al., 2014. Generative adversarial nets. Advances in Neural Information Processing Systems, p.2672–2680.Google Scholar
  15. Grover A, Ermon S, 2017. Boosted generative models. Scholar
  16. Hautamaki V, Karkkainen I, Franti P, 2004. Outlier detection using k-nearest neighbour graph. Proc 17th Int Conf on Pattern Recognition, p.430–433. Scholar
  17. He Z, Deng S, Xu X, 2005. An optimization model for outlier detection in categorical data. LNCS, 3644:400–409. Scholar
  18. Hoffmann H, 2007. Kernel PCA for novelty detection. Patt Recogn, 40(3):863–874. Scholar
  19. Kadurin A, Aliper A, Kazennov A, et al., 2017a. The cornucopia of meaningful leads: applying deep adversarial autoencoders for new molecule development in oncology. Oncotarget, 8(7):10883. Scholar
  20. Kadurin A, Nikolenko S, Khrabrov K, et al., 2017b. dru-GAN: an advanced generative adversarial autoencoder model for de novo generation of new molecules with desired molecular properties in silico. Mol Pharmaceut, 14(9):3098–3104. Scholar
  21. Keogh E, Lonardi S, Ratanamahatana C, 2004. Towards parameter-free data mining. Proc 10th ACM SIGKDD Int Conf on Knowledge Discovery and Data Mining, p.206–215. Scholar
  22. Kim T, Cha M, Kim H, et al., 2017. Learning to discover cross-domain relations with generative adversarial networks. Scholar
  23. Ledig C, Theis L, Huszár F, et al., 2016. Photo-realistic single image super-resolution using a generative adversarial network. Scholar
  24. Li J, Liang X, Wei Y, et al., 2017. Perceptual generative adversarial networks for small object detection. CVPR, p.1951–1959. Scholar
  25. Li Y, Maguire L, 2011. Selecting critical patterns based on local geometrical and statistical information. IEEE Trans Patt Anal Mach Intell, 33(6):1189–1201. Scholar
  26. Li Y, Liu S, Yang J, et al., 2017. Generative face completion. CVPR, p.5892–5900. Scholar
  27. Luc P, Couprie C, Chintala S, et al., 2016. Semantic segmentation using adversarial networks. Scholar
  28. Mahadevan S, Shah S, 2009. Fault detection and diagnosis in process data using one-class support vector machines. J Proc Contr, 19(10):1627–1639. Scholar
  29. Mao X, Li Q, Xie H, et al., 2016. Least squares generative adversarial networks. Scholar
  30. Mogren O, 2016. C-RNN-GAN: continuous recurrent neural networks with adversarial training. Scholar
  31. Patcha A, Park J, 2007. An overview of anomaly detection techniques: existing solutions and latest technological trends. Comput Netw, 51(12):3448–3470. Scholar
  32. Pimentel M, Clifton D, Clifton L, et al., 2014. A review of novelty detection. Signal Process, 99:215–249. Scholar
  33. Radford A, Metz L, Chintala S, 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. Scholar
  34. Reed S, Akata Z, Yan X, et al., 2016. Generative adversarial text to image synthesis. Proc 33rd Int Conf on Machine Learning, p.1060–1069.Google Scholar
  35. Schlegl T, Seeböck P, Waldstein S, et al., 2017. Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. Int Conf on Information Processing in Medical Imaging, p.146–157. Scholar
  36. Springenberg J, 2015. Unsupervised and semi-supervised learning with categorical generative adversarial networks. Scholar
  37. Vondrick C, Pirsiavash H, Torralba A, 2016. Generating videos with scene dynamics. Advances in Neural Information Processing Systems, p.613–621.Google Scholar
  38. Wu J, Zhang C, Xue T, et al., 2016. Learning a probabilistic latent space of object shapes via 3D generativeadversarial modeling. Advances in Neural Information Processing Systems, p.82–90.Google Scholar
  39. Xiao Y, Wang H, Xu W, et al., 2016. Robust one-class SVM for fault detection. Chemometr Intell Lab Syst, 151: 15–25. Scholar
  40. Yang Z, Chen W, Wang F, et al., 2017. Improving neural machine translation with conditional sequence generative adversarial nets. Scholar
  41. Yeh R, Chen C, Lim T, et al., 2016. Semantic image inpainting with perceptual and contextual losses. Scholar
  42. Yi Z, Zhang H, Gong P, et al., 2017. DualGAN: unsupervised dual learning for image-to-image translation. Scholar
  43. Yu J, 2012. Semiconductor manufacturing process monitoring using Gaussian mixture model and Bayesian method with local and nonlocal information. IEEE Trans Semicond Manuf, 25(3):480–493. Scholar
  44. Yu J, Qin S, 2008. Multimode process monitoring with Bayesian inference-based finite Gaussian mixture models. AIChE J, 54(7):1811–1829. Scholar
  45. Yu J, Qin S, 2009. Multiway Gaussian mixture model based multiphase batch process monitoring. Ind Eng Chem Res, 48(18):8585–8594. Scholar
  46. Yu L, Zhang W, Wang J, et al., 2017. SeqGAN: sequence generative adversarial nets with policy gradient. 31st AAAI Conf on Artificial Intelligence, p.2852–2858.Google Scholar
  47. Zhao F, Feng J, Zhao J, et al., 2018. Robust LSTMautoencoders for face de-occlusion in the wild. IEEE Trans Image Process, 27(2):778–790. Scholar
  48. Zhao J, Mathieu M, LeCun Y, 2016. Energy-based generative adversarial network. Scholar
  49. Zhu J, Park T, Isola P, et al., 2017. Unpaired image-to-image translation using cycle-consistent adversarial networks. Scholar

Copyright information

© Zhejiang University and Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Automation, School of Information Science and TechnologyTsinghua UniversityBeijingChina

Personalised recommendations