Skip to main content

A Robust and Effective Learning Algorithm for Feedforward Neural Networks Based on the Influence Function

  • Conference paper
  • First Online:
Pattern Recognition and Image Analysis (IbPRIA 2003)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2652))

Included in the following conference series:

Abstract

The learning process of the Feedforward Artificial Neural Networks relies on the data, though a robustness analysis of the parameter estimates of the model must be done due to the presence of outlying observations in the data. In this paper we seek the robust properties in the parameter estimates in the sense that the influence of aberrant observations or outliers in the estimate is bounded so the neural network is able to model the bulk of data. We also seek a trade off between robustness and efficiency under a Gaussian model. An adaptive learning procedure that seeks both aspects is developed. Finally we show some simulations results applied to the RESEX time series.

This work was supported in part by Research Grant Fondecyt 1010101 and 7010101, in part by ResearchGran t DGIP-UTFSM, and in part by ResearchGran t CHL- 99/023 from the German Ministry of Education and Research (BMBF).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Allende, H., Moraga, C., Salas, R.: Artificial neural networks in time series forecasting: A comparative analysis. Kybernetika 38(6), 685–707 (2002)

    MathSciNet  MATH  Google Scholar 

  2. Allende, H., Moraga, C., Salas, R.: Robust estimator for the learning process in neural networks applied in time series. In: Dorronsoro, J.R. (ed.) ICANN 2002. LNCS, vol. 2415, pp. 1080–1086. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  3. Capobianco, E.: Neural networks and statistical inference. Seeking robust and efficient learning. Comp. Statistics & Data Analysis 32, 443–454 (2000)

    Article  MathSciNet  Google Scholar 

  4. Chen, D., Jain, R.: A robust back propagation learning algorithm for function approximation. IEEE Trans. on Neural Networks 5(3), 467–479 (1994)

    Article  Google Scholar 

  5. Connor, J.T., Martin, R.D.: Recurrent neural networks and robust time series prediction. IEEE Transactions of Neural Networks 2(5), 240–253 (1994)

    Article  Google Scholar 

  6. Golden, R.: Mathematical methods for neural networks analysis and design, vol. 1. MIT Press, Cambridge (1996)

    Google Scholar 

  7. Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., Stahel, W.A.: Robust statistics. Wiley Series in Probability and Mathematical Statistics (1986)

    Google Scholar 

  8. Huber, P.J.: Robust statistics. Wiley Series in probability and mathematical statistics (1981)

    Google Scholar 

  9. Salas, R.: Robustez en redes neuronales feedforward, Master’s thesis, Universidad Técnica Federico Santa María (2002)

    Google Scholar 

  10. White, H.: Artificial neural networks: Approximation and learning theory. Basil Blackwell, Oxford (1992)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Allende, H., Salas, R., Moraga, C. (2003). A Robust and Effective Learning Algorithm for Feedforward Neural Networks Based on the Influence Function. In: Perales, F.J., Campilho, A.J.C., de la Blanca, N.P., Sanfeliu, A. (eds) Pattern Recognition and Image Analysis. IbPRIA 2003. Lecture Notes in Computer Science, vol 2652. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-44871-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-44871-6_4

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40217-6

  • Online ISBN: 978-3-540-44871-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics