Abstract
Classification of multivariate data into two or more classes is an important problem of data processing in many different fields. For the classification of multivariate data into two classes the well-known GMDH MIA (group method data handling multilayer iterative algorithm) is often used. This approach - in contrast to others – can provide even a closed form polynomial solution. Each neuron of the GMDH network has a quadratic transfer function of two input variables that has six parameters. The process of adaptation of the GMDH network is based on standard linear regression.
However, it can be found that the mathematical condition of homoscedasticity for linear regression to get unbiased results is not fulfilled. Thus all neurons have slightly biased parameters and do not give an optimal solution.
Here we introduce a cloning procedure for generating clones of a given neuron that may be better than the original “parent” neuron with the parameters stated by linear regression. We show that cloning together with the use of genetic selection procedure leads to an unconventional type of GMDH algorithm.
We found that cloning is a simple and effective method for obtaining a less biased solution and faster convergence than that obtained by standard linear regression. At the same time, the use of genetic selection procedure allows all neurons already generated to remain potential parents for a new neuron. Thus the problem of deleting excessive neurons during learning disappears. We show that GMC GMDH can outperform other powerful methods. It is demonstrated on tasks from the Machine Learning Repository.
Our results demonstrate that the influence of heteroscedasticity can be easily eliminated by a simple cloning procedure and faster convergence and so better behavior of GMDH algorithm can be obtained.
We suppose that our finding of heteroscedasticity in the GMDH method and its solution by cloning may lead to finding other more effective procedures based e.g. on robust approaches.
Chapter PDF
Similar content being viewed by others
Keywords
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jirina, M., Jirina, M. (2009). Cloning for Heteroscedasticity Elimination in GMDH Learning Procedure. In: Calude, C.S., Costa, J.F., Dershowitz, N., Freire, E., Rozenberg, G. (eds) Unconventional Computation. UC 2009. Lecture Notes in Computer Science, vol 5715. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03745-0_31
Download citation
DOI: https://doi.org/10.1007/978-3-642-03745-0_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03744-3
Online ISBN: 978-3-642-03745-0
eBook Packages: Computer ScienceComputer Science (R0)