Skip to main content

Parametric Optimization of the Selected Classifiers in Binary Classification

  • Chapter
  • First Online:

Part of the book series: Studies in Computational Intelligence ((SCI,volume 710))

Abstract

The conception of classification is one of the major aspects in data processing. Conducted research present comparison of chosen classifiers’ results of classification for a few data sets. All data were chosen from these available on UCI Machine Learning Repository web site. During realization of research, the optimization process of the results of classification was made on the modifiable parameters for particular classifiers. In this work, gathered result of classification was presented as well as conclusion and possibility of future work.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    955 Creston Road, Berkeley, CA 94708, USA (isabelle@clopinet.com).

References

  1. UCI Machine Learning Repository Dorothea data set. Irvine, CA: University of California, School of Information and Computer Science. http://archive.ics.uci.edu/ml/datasets/Dorothea

  2. UCI Machine Learning Repository Dorothea data set. Irvine, CA: University of California, School of Information and Computer Science. http://archive.ics.uci.edu/ml/datasets/Dexter

  3. UCI Machine Learning Repository Dorothea data set. Irvine, CA: University of California, School of Information and Computer Science. http://archive.ics.uci.edu/ml/datasets/Arcene

  4. UCI Machine Learning Repository Dorothea data set. Irvine, CA: University of California, School of Information and Computer Science. http://archive.ics.uci.edu/ml/datasets/Gisette

  5. Weka 3. http://www.cs.waikato.ac.nz/~ml/weka/

  6. Josiński, H., Kostrzewa, D., Michalczuk, A., Świtoński, A.: The exIWO metaheuristic for solving continuous and discrete optimization problems. Sci. World J. 2014, Article ID 831691 (2014). Hindawi Publishing Corporation

    Google Scholar 

  7. Josiński, H., Świtoński, A., Jędrasiak, K., Kostrzewa, D.: Human identification based on gait motion capture data. In: Lecture Notes in Engineering and Computer Science, vol. 2195, pp. 507–510. Hong Kong (2012)

    Google Scholar 

  8. Mehrabian, A.R., Lucas, C.: A novel numerical optimization algorithm inspired from weed colonization. Ecological Informatics 1(4), 355–366 (2006). Elsevier

    Google Scholar 

  9. Pahlavani, P., Delavar, M.R., Frank, A.U.: Using a modified invasive weed optimization algorithm for a personalized urban multi-criteria path optimization problem. Int. J. Appl. Earth Obs. Geoinf. 18, 313–328 (2012). Elsevier

    Google Scholar 

  10. Kostrzewa, D., Josiński, H.: The exIWO metaheuristic—a recapitulation of the research on the join ordering problem. In: Communications in Computer and Information Science, vol. 424, pp. 10–19. Springer (2014)

    Google Scholar 

  11. Haiyang, Z.: A Short Introduction to Data Mining and Its Applications. IEEE (2011)

    Google Scholar 

  12. Agrawal, R., Imielinski, T., Swami, A.N.: Database mining: a performance perspective. IEEE Trans. Knowl. Data Eng. 5(6), 914–925 (1993)

    Article  Google Scholar 

  13. Zero R classifier. http://weka.sourceforge.net/doc.dev/weka/classifiers/rules/ZeroR.html

  14. Aha, D., Kibler, D.: Instance-based learning algorithms. Mach. Learn. 6, 37–66 (1991)

    MATH  Google Scholar 

  15. Freund, Y., Schapire, R.E.: Large margin classification using the perceptron algorithm. In: 11th Annual Conference on Computational Learning Theory, New York, NY, pp. 209–217 (1998)

    Google Scholar 

  16. Platt, J.: Fast training of support vector machines using sequential minimal optimization. In: Schoelkopf, B., Burges, C., Smola, A. (eds.): Advances in Kernel Methods—Support Vector Learning (1998)

    Google Scholar 

  17. Keerthi, S.S., Shevade, S.K., Bhattacharyya, C., Murthy, K.R.K.: Improvements to Platt’s SMO algorithm for SVM classifier design. Neural Comput. 13(3), 637–649 (2001)

    Article  MATH  Google Scholar 

  18. Hastie, T., Tibshirani, R.: Classification by pairwise coupling. Advances in Neural Information Processing Systems (1998)

    Google Scholar 

  19. John, G.H., Langley, P.: Estimating continuous distributions in bayesian classifiers. In: Eleventh Conference on Uncertainty in Artificial Intelligence, San Mateo, pp. 338–345 (1995)

    Google Scholar 

  20. Cleary, J.G., Trigg, L.E.: K*: an instance-based learner using an entropic distance measure. In: 12th International Conference on Machine Learning, pp. 108–114 (1995)

    Google Scholar 

  21. Sumner, M., Frank, E., Hall, M.: Speeding up logistic model tree induction. In: 9th European Conference on Principles and Practice of Knowledge Discovery in Databases, pp. 675–683 (2005)

    Google Scholar 

  22. Weka 3: Documentation. http://weka.sourceforge.net/doc.dev/allclasses-noframe.html

  23. Costa, E.P., Lorena, A.C., Carvalho, A.C.P.L.F., Freitas, A.A.: A review of performance evaluation measures for hierarchical classifiers. In: Evaluation Methods for Machine Learning II, AAAI-2007 Workshop, pp. 182–196. AAAI Press (2007)

    Google Scholar 

  24. Powers, D.M.W.: Evaluation: from precision, recall and F-score to ROC, informedness, markedness & correlation. J. Mach. Learn. Technol. 2, 37–63 (2011)

    Google Scholar 

  25. Provost, F., Fawcett, T., Kohavi, R.: The case against accuracy estimation for comparing classifiers. In: Proceedings of the ICML-98. Morgan Kaufmann, San Francisco, pp. 445–453 (1998)

    Google Scholar 

  26. Smith, M.R., Martinez, T.: Improving classification accuracy by identifying and removing instances that should be misclassified. In: Proceedings of the IEEE International Joint Conference on Neural Networks, pp. 2690–2697 (2011)

    Google Scholar 

  27. Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)

    MathSciNet  MATH  Google Scholar 

  28. Kumar, Y., Sahoo, G.: Analysis of Bayes, Neural Network and Tree Classifier of Classification Technique in Data Mining using WEKA (2012)

    Google Scholar 

  29. Arora, R., Suman: Comparative analysis of classification algorithms on different datasets using WEKA. Int. J. Comput. Appl. 54(13) (2012)

    Google Scholar 

  30. Guyon, I., et al.: Competitive baseline methods set new standards for the NIPS 2003 feature selection benchmark. Pattern Recognit. Lett. 28, 1438–1444 (2007)

    Article  Google Scholar 

  31. Guyon, I., Gunn, S.R., Ben-Hur, A., Dror, G.: Result analysis of the NIPS 2003 feature selection challenge (2004)

    Google Scholar 

  32. KDD Cup 2001. http://www.cs.wisc.edu/~dpage/kddcup2001/

  33. Pearson, K.: Notes on regression and inheritance in the case of two parents. Proc. R. Soc. Lond. 58, 240–242 (1895)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by BKM16/RAu2/507 grant from the Institute of Informatics, Silesian University of Technology.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniel Kostrzewa .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Kostrzewa, D., Brzeski, R. (2017). Parametric Optimization of the Selected Classifiers in Binary Classification. In: Król, D., Nguyen, N., Shirai, K. (eds) Advanced Topics in Intelligent Information and Database Systems. ACIIDS 2017. Studies in Computational Intelligence, vol 710. Springer, Cham. https://doi.org/10.1007/978-3-319-56660-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-56660-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-56659-7

  • Online ISBN: 978-3-319-56660-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics