Skip to main content

Input Value Skewness and Class Label Confusion in the NEFCLASS Neuro-Fuzzy System

  • Conference paper
  • First Online:
Computational Intelligence (IJCCI 2016)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 792))

Included in the following conference series:

  • 244 Accesses

Abstract

Nefclass is a common example of the construction of a neuro-fuzzy system. The popular Nefclass classifier exhibits surprising behaviour when the feature values of the training and testing data sets exhibit significant skew. As skewed feature values are commonly observed in biological data sets, this is a topic that is of interest in terms of the applicability of such a classifier to these types of problems. This paper presents an approach to improve the classification accuracy of the Nefclass classifier, when data distribution exhibits positive skewness. The Nefclass classifier is extended to provide improved classification accuracy over the original Nefclass classifier when trained on skewed data. The proposed model uses two alternative discretization methods, MME and CAIM, to initialize fuzzy sets. From this study it is found that using the MME and CAIM discretization methods results in greater improvements in the classification accuracy of Nefclass as compared to using the original Equal-Width technique Nefclass uses by default.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Gao, J., Hu, W., Li, W., Zhang, Z., Wu, O.: Local outlier detection based on kernel regression. In: Proceedings of the 10th International Conference on Pattern Recognition, Washington, DC, USA, pp. 585–588. EEE Computer Society (2010)

    Google Scholar 

  2. Ben-Gal, I.: Outlier detection. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 131–146. Springer Science & Business Media, Berlin (2010)

    Google Scholar 

  3. Mansoori, E., Zolghadri, M., Katebi, S.: A weighting function for improving fuzzy classification systems performance. Fuzzy Sets Syst. 158, 588–591 (2007)

    Article  MathSciNet  Google Scholar 

  4. Liu, Y., Liu, X., Su, Z.: A new fuzzy approach for handling class labels in canonical correlation analysis. Neurocomputing 71, 1785–1740 (2008)

    Article  Google Scholar 

  5. Peker, N.E.S.: Exponential membership function evaluation based on frequency. Asian J. Math. Stat. 4, 8–20 (2011)

    MathSciNet  Google Scholar 

  6. Chittineni, S., Bhogapathi, R.B.: A study on the behavior of a neural network for grouping the data. Int. J. Comput. Sci. 9, 228–234 (2012)

    Google Scholar 

  7. Changyong, F., Hongyue, W., Naiji, L., Tian, C., Hua, H., Ying, L., Xin, M.: Log-transformation and its implications for data analysis. Shanghai Arch Psychiatry 26, 105–109 (2014)

    Google Scholar 

  8. Qiang, Q., Guillermo, S.: Learning transformations for clustering and classification. J. Mach. Learn. Res. 16, 187–225 (2015)

    MathSciNet  Google Scholar 

  9. Zadkarami, M.R., Rowhani, M.: Application of skew-normal in classification of satellite image. J. Data Sci. 8, 597–606 (2010)

    Article  Google Scholar 

  10. Hubert, M., Van der Veeken, S.: Robust classification for skewed data. Adv. Data Anal. Classif. 4, 239–254 (2010)

    Article  MathSciNet  Google Scholar 

  11. Yousefi, J., Hamilton-Wright, A.: Classification confusion within NEFCLASS caused by feature value skewness in multi-dimensional datasets. In: Proceedings of the \(9^{\text{th}}\) International Joint Conference on Computational Intelligence, Porto, IJCCI-2016 (2016)

    Google Scholar 

  12. Chemielewski, M.R., Grzymala-Busse, J.W.: Global discretization of continuous attributes as preprocessing for machine learning. Int. J. Approx. Reason. 15, 319–331 (1996)

    Article  Google Scholar 

  13. Monti, S., Cooper, G.: A latent variable model for multivariate discretization. In: The Seventh International Workshop on Artificial Intelligence and Statistics, Fort Lauderdale, FL, pp. 249–254 (1999)

    Google Scholar 

  14. Chau, T.: Marginal maximum entropy partitioning yields asymptotically consistent probability density functions. IEEE Trans. Pattern Anal. Mach. Intell. 23, 414–417 (2001)

    Article  Google Scholar 

  15. Gokhale, D.V.: On joint and conditional entropies. Entropy 1, 21–24 (1999)

    Article  MathSciNet  Google Scholar 

  16. Bertoluzza, C., Forte, B.: Mutual dependence of random variables and maximum discretized entropy. Ann. Probab. 13, 630–637 (1985)

    Article  MathSciNet  Google Scholar 

  17. Kerber, R.: ChiMerge discretization of numeric attributes. In: Proceedings of AAAI-92, San Jose Convention Center, San Jose, California, pp. 123–128 (1992)

    Google Scholar 

  18. Kurgan, L.A., Cios, K.: CAIM discretization algorithm. IEEE Trans. Knowl. Data Eng. 16, 145–153 (2004)

    Article  Google Scholar 

  19. Cano, A., Nguyen, D.T., Ventura, S., Cios, K.J.: ur-CAIM: improved CAIM discretization for unbalanced and balanced data. Soft Comput. 33, 173–188 (2016)

    Google Scholar 

  20. Nauck, D., Klawonn, F., Kruse, R.: Neuro-Fuzzy Systems. Wiley, New York (1996)

    Book  Google Scholar 

  21. Nauck, D., Kruse, R.: NEFCLASS-X - a soft computing tool to build readable fuzzy classifiers. BT Technol. J. 16, 180–190 (1998)

    Article  Google Scholar 

  22. Mendel, J.M.: Uncertain Rule-Based Fuzzy Logic Systems. Prentice-Hall, Englewood Cliffs (2001)

    Google Scholar 

  23. Natrella, M.: NIST SEMATECH eHandbook of Statistical Methods. NIST (2003)

    Google Scholar 

  24. Stashuk, D.W., Brown, W.F.: Quantitative electromyography. In: Brown, W.F., Bolton, C.F., Aminoff, M.J. (eds.) Neuromuscular Function and Disease, vol. 1, pp. 311–348. W.B. Saunders, Philadelphia (2002)

    Google Scholar 

  25. Enoka, R., Fuglevand, A.: Motor unit physiology: some unresolved issues. Muscle & Nerve 24, 4–17 (2001)

    Article  Google Scholar 

  26. Varga, R., Matheson, S.M., Hamilton-Wright, A.: Aggregate features in multi-sample classification problems. IEEE Trans. Biomed. Health Inf. 99, 1 (2014). (in press)

    Google Scholar 

Download references

Acknowledgements

The authors gratefully acknowledge the support of NSERC, the National Sciences and Engineering Research Council of Canada, for ongoing grant support.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andrew Hamilton-Wright .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yousefi, J., Hamilton-Wright, A. (2019). Input Value Skewness and Class Label Confusion in the NEFCLASS Neuro-Fuzzy System. In: Merelo, J.J., et al. Computational Intelligence. IJCCI 2016. Studies in Computational Intelligence, vol 792. Springer, Cham. https://doi.org/10.1007/978-3-319-99283-9_9

Download citation

Publish with us

Policies and ethics