Multi-class Classification with One-Against-One Using Probabilistic Extreme Learning Machine

  • Li-jie Zhao
  • Tian-you Chai
  • Xiao-kun Diao
  • De-cheng Yuan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7368)


Probabilistic extreme learning machine (PELM) is a binary classification method, which can improve the computational speed, generalization performance and computational cost. In this work we extend the binary PELM to resolve multi-class classification problems by using one-against-one (OAO) and winner-takes-all strategy. The strategy one-against-one (OAO) involves C(C-1)/2 binary PELM models. A reliability for each sample is calculated from each binary PELM model, and the sample is assigned to the class with the largest combined reliability by using the winner-takes-all strategy. The proposed method is verified with the operational conditions classification of an industrial wastewater treatment plant. Experimental results show the good performance on classification accuracy and computational expense.


Extreme learning machine probabilistic extreme learning machine Binary classification Wastewater treatment 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Rosen, C.: A Chemometric Approach to Process Monitoring and Control With Applications to Wastewater Treatment Operation. Doctoral Dissertation, Lund university, SWEDEN (2001)Google Scholar
  2. 2.
    Widodo, A., Yang, B.-S.: Support vector machine in machine condition monitoring and fault diagnosis. Mechanical Systems and Signal Processing 21, 2560–2574 (2007)CrossRefGoogle Scholar
  3. 3.
    Rosen, C., Yuan, Z.: Supervisory control of wastewater treatment plants by combining principal component analysis and fuzzy c-means clustering. Water Science Technology 43(7), 147–156 (2001)Google Scholar
  4. 4.
    Tomita, R.K., Park, S.W., Sotomayor, O.A.Z.: Analysis of activated sludge process using multivariate statistical tools-a PCA approach. Chemical Engineering Journal 90(3), 283–290 (2002)CrossRefGoogle Scholar
  5. 5.
    Moon, T.S., Kim, Y.J., Kim, J.R., Cha, J.H., Kim, D.H., Kim, C.W.: Identification of process operating state with operational map in municipal wastewater treatment plant. Journal of Environmental Management 90(2), 772–778 (2009)CrossRefGoogle Scholar
  6. 6.
    Teppola, P., Mujunen, S.-P., Minkkinen, P.: Adaptive Fuzzy C-Means clustering in process monitoring. Chemometrics and Intelligent Laboratory Systems 45(1-2), 23–38 (1999)CrossRefGoogle Scholar
  7. 7.
    Singh, K.P., Basant, N., Gupta, S.: Support Vector Machines in Water Quality Management. Analytica Chimica Acta 703(2), 152–162 (2011)CrossRefGoogle Scholar
  8. 8.
    Boger, Z.: Application of Neural Networks to Water and Wastewater Treatment Plant Operation. ISA Transactions 31(1), 25–33 (1992)CrossRefGoogle Scholar
  9. 9.
    Barker, M., Rayens, W.: Partial least squares for discrimination. Journal of Chemometrics 17, 166–173 (2003)CrossRefGoogle Scholar
  10. 10.
    Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: Theory and applications. Neurocomputing 70(1-3), 489–501 (2006)CrossRefGoogle Scholar
  11. 11.
    Huang, G.B., Chen, L.: Enhanced random search based incremental extreme learning machine. Neurocomputing 71(16-17), 3460–3468 (2008)CrossRefGoogle Scholar
  12. 12.
    Huang, G.B., Wang, D.H., Lan, Y.: Extreme Larning Machines: A survey. International Journal of Machine Learning and Cybernetics 2, 107–122 (2011)CrossRefGoogle Scholar
  13. 13.
    Pérez, N.F., Ferré, J., Boqué, R.: Calculation of the reliability of classification in discriminant partial least-squares binary classification. Chemometrics and Intelligent Laboratory Systems 95(2), 122–128 (2009)CrossRefGoogle Scholar
  14. 14.
    Zhao, L.J., Diao, X.K., Yuan, D.C., Tang, W.: Enhanced classification based on probabilistic extreme learning mache in wastewater treatment process. Procedia Engineering 15(1), 5563–5567 (2011)CrossRefGoogle Scholar
  15. 15.
    Pérez, N.F., Ferrér, J., Boqué, R.: Multi-class classification with probabilistic discriminant partial least squares (p-DPLS). Analytical Chemical Acts 664, 27–33 (2010)CrossRefGoogle Scholar
  16. 16.
    Cervantes, J., Li, X., Yu, W., Li, K.: Support vector machine classification for large data sets via minimum enclosing ball clustering. Neurocomputing 71, 611–619 (2008)CrossRefGoogle Scholar
  17. 17.
    Zong, W., Huang, G.-B.: Face recognition based on extreme learning machine. Neurocomputing (in press, 2012)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Li-jie Zhao
    • 1
    • 2
  • Tian-you Chai
    • 1
  • Xiao-kun Diao
    • 2
  • De-cheng Yuan
    • 2
  1. 1.State Key Laboratory of Synthetical Automation for Process IndustriesNortheastern UniversityShenyangChina
  2. 2.College of Information EngineeringShenyang University of Chemical TechnologyShenyangChina

Personalised recommendations