Research on a new automatic generation algorithm of concept map based on text analysis and association rules mining

  • Zengzhen ShaoEmail author
  • Yancong Li
  • Xiao Wang
  • Xuechen Zhao
  • Yanhui Guo
Original Research


As an important knowledge visualization tool, concept map has become a research hotspot in educational data mining. Traditional concept map generation algorithms are difficult to generate concept maps quickly because of their strong reliance on experts’ experience. A hybrid TA-ARM algorithm for automatic generation of concept map based on text analysis and association rule mining is proposed. The TA-ARM algorithm fully considers the association rules between concepts, uses the text classification algorithm in text analysis technology instead of manually classify the questions into concepts, and combines the association rule mining method to generate concept maps. The experimental result shows that the TA-ARM algorithm can automatically and rapidly generate the concept map, which not only reduces the impact of outside experts, but can also dynamically adjusts the concept map based on the parameters such as the threshold of confidence between test questions. The concept map generated by the TA-ARM algorithm expresses the association rules between the concepts and the degree of closeness through the associated pairs and relevant degree, and can clearly show the structural associations between concepts. The contrast experiment shows that the quality of the concept map automatically generated by the TA-ARM has a high quality and can visualize the associations between concepts and provide optimization and guidance for knowledge visualization.


Concept map Educational data mining Automatic generation Text analysis Text classification Association rules mining 



The authors are grateful to the anonymous reviewers for their constructive comments and invaluable contributions to enhance the presentation of this paper. This work was supported by National Natural Science Foundation of China (no. 71672154), Humanities and Social Sciences Foundation of the Ministry of Education of China (no. 16YJA630038), Joint Research Project between Southwest Jiaotong University and Cornell University (No. 268SWJTU15WTD01), China Postdoctoral Science Foundation (no. 2016M592697), Key Science and Technology Project of Shandong Province of China (no. 2014GGH201022), and Chang Jiang Scholars Program of China.


  1. Acharya A, Sinha D (2015) Construction of automated concept map of learning using hashing technique advances. Intell Syst Comput 327:567–578Google Scholar
  2. Acharya A, Sinha D (2017) An educational data mining approach to concept map construction for web based learning. Inf Econ 21:41–58. Google Scholar
  3. Agrawal R, Imielinski T, Swami AN (1993) Mining association rules between sets of items in large databases. In: SIGMOD ConferenceGoogle Scholar
  4. Atapattu T, Falkner K, Falkner N (2017) A comprehensive text analysis of lecture slides to generate concept maps. Comput Educ 115:96–113CrossRefGoogle Scholar
  5. Bai SM, Chen SM (2008) Automatically constructing concept maps based on fuzzy rules for adapting learning systems. Expert Syst Appl 35:41–49CrossRefGoogle Scholar
  6. Baker RS (2014) Educational data mining: an advance for intelligent systems in education. IEEE Intell Syst 29:78–82CrossRefGoogle Scholar
  7. Bertsimas D, King A (2017) Logistic regression: from art to science. Stat Sci 32:367–384. MathSciNetCrossRefzbMATHGoogle Scholar
  8. Booth DE (2007) Data mining methods and models. Technometrics 49:500–500Google Scholar
  9. Cao P (2016) On the transforming paths to future school—orientation and sustainable development of “internet + education”. Educ Res 41:46–51Google Scholar
  10. Caputo GM, Ebecken NFF (2011) Concept map construction applying natural language processing on text extracted from e-commerce web pages. In: Nature and biologically inspired computing, 2011 Third World Congress on, IEEE, pp 409–414Google Scholar
  11. Chen SM, Sue PJ (2013) Constructing concept maps for adaptive learning systems based on data mining techniques. Expert Syst Appl 40:2746–2755CrossRefGoogle Scholar
  12. Chen NS, Kinshuk P, Wei CW, Chen HJ (2006) Mining e-learning domain concept map from academic articles. In: IEEE international conference on advanced learning technologies, pp 694–698Google Scholar
  13. Coffey JW, Hoffman RR, Cañas AJ, Ford KM (2002) A concept map-based knowledge modeling approach to expert knowledge sharing. In: Boumedine M (Ed), proceedings of IKS 2002—the IASTED internationalGoogle Scholar
  14. Cohen KB (2004) Natural language processing for online applications: text retrieval, extraction and categorization (review). Language 80:510–511Google Scholar
  15. Cowan AM (2002) Data Mining in Finance: Advances in Relational and Hybrid Methods: Boris Kovalerchuk and Evgenii Vityaev (Eds.), Kluwer Academic Publishers, Norwell, Massachusetts, 2000, HB US $120, ISBN 0-7923-7804-0. Int J Forecast 18:155–156CrossRefGoogle Scholar
  16. El-Khair IA (2009) TF*IDF Encyclopedia of Database Systems 13:3085–3086Google Scholar
  17. Heiner C, Heffernan N (2014) Educational data mining. Stud Comput Intell 1(1):467–474Google Scholar
  18. Hirashima T, Yamasaki K, Fukuda H, Funaoi H (2015) Framework of kit-build concept map for automatic diagnosis and its preliminary use research & practice. Technol Enhanc Learn 10:17CrossRefGoogle Scholar
  19. Hirschman L, Park JC, Tsujii J, Wong L, Wu CH (2002) Accomplishments and challenges in literature data mining for biology. Bioinformatics 18:1553–1561CrossRefGoogle Scholar
  20. Huang X, Yang K, Lawrence VB (2015) An efficient data mining approach to concept map generation for adaptive learning. In: Industrial conference on data mining, pp 247–260Google Scholar
  21. Islam A, Inkpen D, Kiringa I (2008) Applications of corpus-based semantic similarity and word segmentation to database schema matching. Vldb Journal 17:1293–1320CrossRefGoogle Scholar
  22. Jiang Y, Tian F, Wang X, Zhang X, Dai G, Wang H (2009) Structuring and manipulating hand-drawn concept maps. In: Universal communication symposium, pp 457–462Google Scholar
  23. Kaddoura M, Vandyke O, Cheng B, Shea-Foisy K (2016) Impact of concept mapping on the development of clinical judgment skills in nursing students teaching & learning. Nursing 11:101–107Google Scholar
  24. Kurbatow A (2015) The research of text preprocessing effect on text documents classification efficiency. In: “stability and control processes” in memory of V.i. Zubov, pp 653–655Google Scholar
  25. Lai CF et al (2017) Using information retrieval to construct an intelligent E-book with. Keyword Concept Map 13:6637–6647Google Scholar
  26. Larose DT (2004) k-nearest neighbor algorithm. Wiley, New YorkCrossRefGoogle Scholar
  27. Li L et al (2004) Data mining techniques for cancer detection using serum proteomic profiling. Artif Intell Med 32:71–83CrossRefGoogle Scholar
  28. Markham KM, Mintzes JJ, Jones MG (2010) The concept map as a research and evaluation tool: Further evidence of validity. J Res Sci Teach 31:91–101CrossRefGoogle Scholar
  29. Matsumoto T, Sunayama W, Hatanaka Y, Ogohara K (2017) Data analysis support by combining data mining and text mining. In: Iiai international congress on advanced applied informatics, pp 313–318Google Scholar
  30. Mccallum A (1998) A comparison of event models for naive bayes text classification. In: AAAI-98 workshop on learning for text categorization, pp 41–48Google Scholar
  31. Melucci M (2017) Vector-space model. In: Liu L, Özsu M (eds) Encyclopedia of database systems. Springer, New York, pp 1–6. Google Scholar
  32. Moschitti A (2003) A Study on optimal parameter tuning for rocchio text classifier lecture notes. in Computer Science 2633:420–435zbMATHGoogle Scholar
  33. Noble WS (2006) What is a support vector machine? Nat Biotechnol 24:1565–1567CrossRefGoogle Scholar
  34. Novak JD, Cañas AJ (2007) Theoretical origins of concept maps, how to construct them, and uses in education. Reflect Educ 3(1):29–42Google Scholar
  35. Novak JD, Gowin DB (1984) Learning how to learn. Cambridge University Press, CambridgeCrossRefGoogle Scholar
  36. Nugumanova A et al (2015) Automatic generation of concept maps based on collection of teaching materials. In: International conference on data management technologies and applications, pp 248–254Google Scholar
  37. Oppl S, Stary C (2017) Effects of a tabletop interface on the co-construction of concept maps. In: Human-computer interaction—INTERACT 2011—Ifip Tc 13 international conference, Lisbon, Portugal, September 5–9, 2011, proceedings, pp 443–460Google Scholar
  38. Paul RS (2012) A review of “learning, creating, and using knowledge: concept maps as facilitative tools in schools and corporation”. Inf Soc 28:57–59CrossRefGoogle Scholar
  39. Qasim I, Jeong JW, Heu JU, Lee DH (2013) Concept map construction from text documents using affinity propagation. J Inf Sci 39:719–736CrossRefGoogle Scholar
  40. Romero C, Ventura S (2007) Educational data mining: a survey from 1995 to 2005. Expert Syst Appl 33:135–146CrossRefGoogle Scholar
  41. Santos V (2018) Concept maps construction using natural language processing to support studies selection. In: SAC 2018, Pau, France, 9–13 April 2018, ACM. ISBN 978-1-4503-5191-1/18/04
  42. Slater S, Joksimovic S, Kovanovic V, Baker RS, Gasevic D (2018) Tools for educational data mining: a review. J Open Learn 42:85–106Google Scholar
  43. Steinbach MA (2000) comparison of document clustering techniques. In: World text mining conferenceGoogle Scholar
  44. Toivonen H (2011) Apriori algorithm. In: Sammut C, Webb GI (eds) Encyclopedia of machine learning. Springer, Boston, MA. Google Scholar
  45. Tseng SS, Sue PC, Su JM, Weng JF, Tsai WN (2007) A new approach for constructing the concept map. Comput Educ 49:691–707CrossRefGoogle Scholar
  46. Zhang HP, Zhou N, Chen YY (2007) Research on application of concept map in knowledge organization. Inf Sci 25(10):1570–1574Google Scholar
  47. Zhang S, Li X, Zong M, Zhu X, Cheng D (2017) Learning k for kNN. Classif ACM Trans Intell Syst Technol 8:43Google Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of Data Science and Computer ScienceShandong Women’s UniversityJinanChina
  2. 2.School of Information Science and EngineeringShandong Normal UniversityJinanChina

Personalised recommendations