Advertisement

On robustness of radial basis function network with input perturbation

  • Prasenjit Dey
  • Madhumita Gopal
  • Payal Pradhan
  • Tandra Pal
Original Article
  • 65 Downloads

Abstract

In this article, we have proposed a methodology for making a radial basis function network (RBFN) robust with respect to additive and multiplicative input noises. This is achieved by properly selecting the centers and widths for the radial basis function (RBF) units of the hidden layer. For this purpose, firstly, a set of self-organizing map (SOM) networks are trained for center selection. For training a SOM network, random Gaussian noise is injected in the samples of each class of the data set. The number of SOM networks is same as the number of classes present in the data set, and each of the SOM networks is trained separately by the samples belonging to a particular class. The weight vector associated with a unit in the output layer of a particular SOM network corresponding to a class is used as the center of a RBF unit for that class. To determine the widths of the RBF units, p-nearest neighbor algorithm is used class-wise. Proper selection of centers and widths makes the RBFN robust with respect to input perturbation and outliers present in the data set. The weights between the hidden and output layers of RBFN are obtained by pseudo inverse method. To test the robustness of the proposed method in additive and multiplicative noise scenarios, ten standard data sets have been used for classification. Proposed method has been compared with three existing methods, where the centers have been generated in three ways: randomly, using k-means algorithm, and based on SOM network. Simulation results show the superiority of the proposed method compared to those methods. Wilcoxon signed-rank test also shows that the proposed method is statistically better than those methods.

Keywords

Additive noise Gaussian noise Multiplicative noise Radial basis function network Robustness Self-organizing map 

Notes

Compliance with ethical standards

Conflict of interest

We have tried our best to minimize the overlap between this manuscript and published articles for fragments of sentences and technical terms. We do not have any conflict of interest with others.

References

  1. 1.
    Lowe D (1988) Multi-variable functional interpolation and adaptive networks. Complex Syst 2:321–355MATHGoogle Scholar
  2. 2.
    Saha A, Wu CL, Tang DS (1993) Approximation, dimension reduction, and nonconvex optimization using linear superpositions of gaussians. IEEE Trans Comput 42(10):1222–1233MathSciNetCrossRefGoogle Scholar
  3. 3.
    Bernier JL, Díaz AF, Fernández F, Cañas A, González J, Martin-Smith P, Ortega J (2003) Assessing the noise immunity and generalization of radial basis function networks. Neural Process Lett 18(1):35–48CrossRefGoogle Scholar
  4. 4.
    Webb AR (1994) Functional approximation by feed-forward networks: a least-squares approach to generalization. IEEE Trans Neural Netw 5(3):363–371CrossRefGoogle Scholar
  5. 5.
    Haykin S, Network N (2004) A comprehensive foundation. Neural Netw 2:2004Google Scholar
  6. 6.
    Eickhoff R, Rückert U (2007) Robustness of radial basis functions. Neurocomputing 70(16):2758–2767CrossRefGoogle Scholar
  7. 7.
    Yu H, Xie T, Paszczynski S, Wilamowski BM (2011) Advantages of radial basis function networks for dynamic system design. IEEE Trans Ind Electron 58(12):5438–5450CrossRefGoogle Scholar
  8. 8.
    Cover TM (1965) Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition. IEEE Trans Electron Comput 3:326–334CrossRefMATHGoogle Scholar
  9. 9.
    Moody J, Darken CJ (1989) Fast learning in networks of locally-tuned processing units. Neural Comput 1(2):281–294CrossRefGoogle Scholar
  10. 10.
    Bishop C (1991) Improving the generalization properties of radial basis function neural networks. Neural Comput 3(4):579–588CrossRefGoogle Scholar
  11. 11.
    Chen S, Cowan CF, Grant PM (1991) Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans Neural Netw 2(2):302–309CrossRefGoogle Scholar
  12. 12.
    Whitehead BA, Choate TD (1996) Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction. IEEE Trans Neural Netw 7(4):869–880CrossRefGoogle Scholar
  13. 13.
    Schölkopf B, Sung KK, Burges CJ, Girosi F, Niyogi P, Poggio T, Vapnik V (1997) Comparing support vector machines with gaussian kernels to radial basis function classifiers. IEEE Trans Signal Process 45(11):2758–2765CrossRefGoogle Scholar
  14. 14.
    Mao K (2002) Rbf neural network center selection based on fisher ratio class separability measure. IEEE Trans Neural Netw 13(5):1211–1217CrossRefGoogle Scholar
  15. 15.
    Mao KZ, Huang GB (2005) Neuron selection for RBF neural network classifier based on data structure preserving criterion. IEEE Trans Neural Netw 16(6):1531–1540CrossRefGoogle Scholar
  16. 16.
    Orr MJ (1995) Regularization in the selection of radial basis function centers. Neural Comput 7(3):606–623CrossRefGoogle Scholar
  17. 17.
    Cohen S, Intrator N (2000) Global optimization of RBF networks. http://www.cs.tau.ac.il/~nin/papers/rbf.pdf (cf. p. 156)
  18. 18.
    Schwenker F, Kestler HA, Palm G (2001) Three learning phases for radial-basis-function networks. Neural Netw 14(4):439–458CrossRefMATHGoogle Scholar
  19. 19.
    Fritzke B (1994) Growing cell structures a self-organizing network for unsupervised and supervised learning. Neural Netw 7(9):1441–1460CrossRefGoogle Scholar
  20. 20.
    Anouar F, Badran F, Thiria S (1998) Probabilistic self-organizing map and radial basis function networks. Neurocomputing 20(1):83–96CrossRefMATHGoogle Scholar
  21. 21.
    Bouchired S, Ibnkahla M, Roviras D, Castanié F (1998) Equalization of satellite mobile communication channels using combined self-organizing maps and RBF networks. In: Proceedings of the 1998 IEEE international conference on acoustics, speech and signal processing, 1998, vol 6. IEEE, pp 3377–3379Google Scholar
  22. 22.
    Andrieu C, De Freitas N, Doucet A (2001) Robust full bayesian learning for radial basis networks. Neural Comput 13(10):2359–2407CrossRefMATHGoogle Scholar
  23. 23.
    Townsend NW, Tarassenko L (1999) Estimations of error bounds for neural-network function approximators. IEEE Trans Neural Netw 10(2):217–230CrossRefGoogle Scholar
  24. 24.
    Ikonomopoulos A, Endou A (1998) Wavelet decomposition and radial basis function networks for system monitoring. IEEE Trans Nuclear Sci 45(5):2293–2301CrossRefGoogle Scholar
  25. 25.
    Lee CC, Chung PC, Tsai JR, Chang CI (1999) Robust radial basis function neural networks. IEEE Trans Syst Man Cybern B Cybern 29(6):674–685Google Scholar
  26. 26.
    Bruzzone L, Prieto DF (1999) A technique for the selection of kernel-function parameters in rbf neural networks for classification of remote-sensing images. IEEE Trans Geosci Remote Sens 37(2):1179–1184CrossRefGoogle Scholar
  27. 27.
    Ho KI, Leung CS, Sum J (2010) Convergence and objective functions of some fault/noise-injection-based online learning algorithms for rbf networks. IEEE Trans Neural Netw 21(6):938–947CrossRefGoogle Scholar
  28. 28.
    Tinós R, Terra MH (2001) Fault detection and isolation in robotic manipulators using a multilayer perceptron and a rbf network trained by the Kohonen’s self-organizing map. Rev Soc Bras Autom Contr Autom 12(1):11–18Google Scholar
  29. 29.
    Shi D, Yeung DS, Gao J (2005) Sensitivity analysis applied to the construction of radial basis function networks. Neural Netw 18(7):951–957CrossRefMATHGoogle Scholar
  30. 30.
    Yeung DS, Chan PP, Ng WW (2009) Radial basis function network learning using localized generalization error bound. Inf Sci 179(19):3199–3217CrossRefMATHGoogle Scholar
  31. 31.
    Tu S, Ben K, Tian L, Zhang L (2008) Combination of SOM and RBF based on incremental learning for acoustic fault identification of underwater vehicles. In: Congress on image and signal processing, 2008 (CISP’08), vol 4. IEEE, pp 38–42Google Scholar
  32. 32.
    Yao W, Chen X, Luo W (2009) A gradient-based sequential radial basis function neural network modeling method. Neural Comput Appl 18(5):477–484CrossRefGoogle Scholar
  33. 33.
    Han H, Chen Q, Qiao J (2010) Research on an online self-organizing radial basis function neural network. Neural Comput Appl 19(5):667–676CrossRefGoogle Scholar
  34. 34.
    Ding S, Xu L, Su C, Jin F (2012) An optimizing method of rbf neural network based on genetic algorithm. Neural Comput Appl 21(2):333–336CrossRefGoogle Scholar
  35. 35.
    Hartono P (2016) Classification and dimensional reduction using restricted radial basis function networks. Neural Comput Appl. doi: 10.1007/s00521-016-2726-5 Google Scholar
  36. 36.
    Bishop CM (1995) Training with noise is equivalent to Tikhonov regularization. Neural Comput 7(1):108–116CrossRefGoogle Scholar
  37. 37.
    Wahba G (1990) Spline models for observational data, vol 59. SIAM, PhiladelphiaCrossRefMATHGoogle Scholar
  38. 38.
    Frank A, Asuncion A (2010) UCI machine learning repository, vol 213. University of California, IrvineGoogle Scholar

Copyright information

© The Natural Computing Applications Forum 2017

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringNIT DurgapurDurgapurIndia

Personalised recommendations