Generating an Evolving Skills Network from Job Adverts for High-Demand Skillset Discovery

  • Elisa Margareth SibaraniEmail author
  • Simon ScerriEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11881)


Understanding the needs of highly-dynamic job market sectors is of crucial importance to job seekers, employers, and educational bodies alike. This paper describes efforts to identify skill demand composition and dynamics by constructing and interpreting a time series of skills networks that are routinely identified through an established agglomerative hierarchical clustering with breadth-first search order based on co-word occurrences. We focus on Data Science as an example of a highly dynamic sector. Data collected from job adverts between 2016–2017 is pre-processed to identify distinct evolving skills networks observed over at least 12 months. These result in 40 time-series that are used to track the evolving skills clusters and to define the skillsets in high-demand. To return a quantitative scientific result, we implement three traditional statistical models (Naive, Simple Exponential Smoothing (SES), and Holt’s linear trend) to forecast future skills cluster composition. The analysis is done based on the centrality and density indices generated for each evolving cluster within the skills networks. Forecasts based on the previous quarter(s) are then checked against actual observations in terms of positioning within a density- and centrality-based strategic quadrant. The F-measures observed (75% and 73% for two top methods) demonstrate the suitability of our approach to identify core skillsets in the near future based on recent data with a high level of accuracy.


Graph mining Network clustering Time-evolving network 



This work has been co-funded by the European Union’s Horizon 2020 research and innovation programme under the QualiChain project, Grant Agreement No 822404.


  1. 1.
    Sodhi, M.S., Son, B.-G.: Content analysis of OR job advertisements to infer required skills. J. Oper. Res. Soc. 61(9), 1315–1327 (2010)CrossRefGoogle Scholar
  2. 2.
    Smith, D., Ali, A.: Analyzing computer programming job trend using web data mining. Issues Informing Sci. Inf. Technol. 11, 203–214 (2014)CrossRefGoogle Scholar
  3. 3.
    Sibarani, E.M., Scerri, S., Morales, C., Auer, S., Collarana, D.: Ontology-guided job market demand analysis: a cross-sectional study for the data science field. In: SEMANTiCS 2017, pp. 25–32. ACM, New York (2017).
  4. 4.
    Coulter, N., Monarch, I., Konda, S.: Software engineering as seen through its research literature: a study in co-word analysis. J. Am. Soc. Inform. Sci. 49(13), 1206–1223 (1998)CrossRefGoogle Scholar
  5. 5.
    Newman, M.E.J., Girvan, M.: Finding and evaluating community structure in networks. Phys. Rev. E 69, 026113 (2004)CrossRefGoogle Scholar
  6. 6.
    Xu, X., Yuruk, N., Feng, Z., Schweiger, T.A.J.: SCAN: a structural clustering algorithm for networks. In: KDD 2007, pp. 824–833. ACM, New York (2007).
  7. 7.
    Blondel, V.D., Guillaume, J.-L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech: Theory Exp. 10, P10008 (2008)CrossRefGoogle Scholar
  8. 8.
    He, Q.: Knowledge discovery through co-word analysis. Libr. Trends 48(1), 133–159 (1999)Google Scholar
  9. 9.
    Callon, M., Courtial, J.-P., Laville, F.: Co-word analysis as a tool for describing the network of interactions between basic and technological research: the case of polymer chemistry. Scientometrics 22(1), 155–205 (1991)CrossRefGoogle Scholar
  10. 10.
    Kobayashi, V.B., Mol, S.T., Berkers, H.A., Kismihók, G., Den Hartog, D.N.: Text mining in organizational research. Organ. Res. Methods 21(3), 733–765 (2018)CrossRefGoogle Scholar
  11. 11.
    Kotu, V., Deshpande, B.: Time series forecasting. In: Kotu, V., Deshpande, B. (eds.) Predictive Analytics and Data Mining, pp. 305–327. Morgan Kaufmann, Boston (2015)CrossRefGoogle Scholar
  12. 12.
    Fu, T.-C.: A review on time series data mining. Eng. Appl. Artif. Intell. 24(1), 164–181 (2011)CrossRefGoogle Scholar
  13. 13.
    Dadzie, A.-S., Sibarani, E.M., Novalija, I., Scerri, S.: Structuring visual exploratory analysis of skill demand. Web Seman. Sci. Serv. Agents World Wide Web 49, 51–70 (2018). Scholar
  14. 14.
    Polanco, X.: Co-word analysis revisited: modelling co-word clusters in terms of graph theory. In: Proceedings of the 10th International Conference on Scientometrics and Informetrics, vol. 2, pp. 662–663 (2005)Google Scholar
  15. 15.
    Hyndman, R.J., Athanasopoulos, G.: Forecasting: Principles and Practice. Accessed 30 May 2019

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University of BonnBonnGermany
  2. 2.Institut Teknologi DelToba SamosirIndonesia
  3. 3.Fraunhofer IAISSankt AugustinGermany

Personalised recommendations