Abstract
This paper presents an attempt at an analysis of parametric evaluation of research units with machine learning toolkit. The main goal was to investigate if the rules of evaluation can be expressed in a readable, transparent, and easy to interpret way. A further attempt was made at investigating consistency of the applied procedure and presentation of some observed anomalies.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Rozporządzenie Ministra Nauki i Szkolnictwa Wyższego z dn. 13 lipca 2012 w sprawie kryteriów i trybu przyznawania kategorii naukowej jednostkom naukowym. Dziennik Ustaw Rzeczypospolitej Polskiej, Warszawa, 1 sierpnia (2012)
Cios, K.J., Pedrycz, W., Swiniarski, R.W., Kurgan, L.A.: Data Mining. A Knowledge Discovery Approach. Springer Science+Business Media, LLC, New York (2007)
Flach, P.: Machine Learning. The Art and Science of Algorithms that Make the Sense of Data. Cambridge University Press, Cambridge (2012)
Frank, E., Witten, I.H.: Generating Accurate Rule Sets Without Global Optimization. In: Fifteenth International Conference on Machine Learning, pp. 144–151 (1998)
Huehn, J.C., Huellermeier, E.: FURIA: An Algorithm for Unordered Fuzzy Rule Induction. Data Mining and Knowledge Discovery (2009)
Hwang, C.-L., Masud, A.S.M.: Multiple objective decision making, methods and applications: a state-of-the-art survey. Springer (1979)
Gaines, B.R., Compton, P.: Induction of ripple-down rules applied to modeling large databases. Journal of Intelligent Information Systems 5(3), 211–228 (1995)
Miettinen, K.: Nonlinear Multiobjective Optimization. Springer (1999)
Quinlan, R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Mateo (1993)
Landwehr, N., Hall, M., Frank, E.: Logistic Model Trees. Machine Learning 95(1-2), 161–205 (2005)
Sumner, M., Frank, E., Hall, M.: Speeding Up Logistic Model Tree Induction. In: Jorge, A.M., Torgo, L., Brazdil, P.B., Camacho, R., Gama, J. (eds.) PKDD 2005. LNCS (LNAI), vol. 3721, pp. 675–683. Springer, Heidelberg (2005)
Chang, C.-C., Lin, C.-J.: LIBSVM — A Library for Support Vector Machines (2001), http://www.csie.ntu.edu.tw/~cjlin/libsvm/
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA Data Mining Software: An Update. SIGKDD Explorations 11(1) (2009)
The Results of Parametric Evaluation of Polish Research Units, http://www.nauka.gov.pl/komunikaty/komunikat-o-wynikach-kompleksowej-oceny-dzialalnosci-naukowej-lub-badawczo-rozwojowej-jednostek-naukowych.html
Colomer, J.M.: Ramon Llull: from ‘Ars electionis’ to social choice theory. Social Choice and Welfare 40(2), 317–328 (2011)
Bana e Costa, C.A., Vansnick, J.: A critical analysis of the eigenvalue method used to derive priorities in AHP. European Journal of Operational Research 187(3), 1422–1428 (2008)
Dyer, J.S.: Remarks on the analytic hierarchy process. Management Science 36(3), 249–258 (1990)
Fedrizzi, M., Giove, S.: Incomplete pairwise comparison and consistency optimization. European Journal of Operational Research 183(1), 303–313 (2007)
Greco, S., Matarazzo, B., Słowiński, R.: Dominance-based rough set approach on pairwise comparison tables to decision involving multiple decision makers. In: Yao, J., Ramanna, S., Wang, G., Suraj, Z. (eds.) RSKT 2011. LNCS, vol. 6954, pp. 126–135. Springer, Heidelberg (2011)
Koczkodaj, W.W.: A new definition of consistency of pairwise comparisons. Math. Comput. Model. 18(7), 79–84 (1993)
Koczkodaj, W.W., Kułakowski, K., Ligęza, A.: On the Quality Evaluation of Scientific Entities in Poland supported by Consistency-Driven Pairwise Comparisons Method. Scientometrics (accepted for publication, 2014)
Kułakowski, K.: A heuristic rating estimation algorithm for the pairwise comparisons method. Central European Journal of Operations Research, 1–17 (2013)
Perron, O.: Zur Theorie der Matrices. Mathematische Annalen 64(2), 248–263 (1907)
Saaty, T.L.: A scaling method for priorities in hierarchical structures. Journal of Mathematical Psychology 15(3), 234–281 (1977)
Thurstone, L.L.: A law of comparative judgment, reprint of an original work published in 1927. Psychological Review 101, 266–270 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Baran, M., Kułakowski, K., Ligęza, A. (2014). A Note on Machine Learning Approach to Analyze the Results of Pairwise Comparison Based Parametric Evaluation of Research Units. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds) Artificial Intelligence and Soft Computing. ICAISC 2014. Lecture Notes in Computer Science(), vol 8468. Springer, Cham. https://doi.org/10.1007/978-3-319-07176-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-07176-3_3
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07175-6
Online ISBN: 978-3-319-07176-3
eBook Packages: Computer ScienceComputer Science (R0)