Skip to main content

Big Data Enables Labor Market Intelligence

  • Living reference work entry
  • Latest version View entry history
  • First Online:
Encyclopedia of Big Data Technologies

Definitions

Labor market intelligence (LMI):

is a term that is emerging in the whole labor market community, especially in the European Union. Although there is no unified definition of what LMI is, it can be referred to the design and use of AI algorithms and frameworks to analyze data related to labor market (aka labor market information) for supporting policy and decision-making (see, e.g., UK Commission for Employment and Skills 2015; UK Department for Education and Skills 2004).

Classification system or taxonomy:

in the field of labor market refers to a taxonomy or a graph that organizes jobs into a clearly defined set of groups according to the tasks and duties undertaken in the job, as in the case of the International Standard Classification System ISCO (Organization IL 2017) and the US classification system O*NET (U.S. Department of Labor/Employment & Training Administration 2017). Recently, such systems have been improved to take into account also skills, competences, and...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  • Anne Kennan M, Cole F, Willard P, Wilson C, Marion L (2006) Changing workplace demands: what job Ads tell us. In: Aslib proceedings, vol 58. Emerald group publishing limited, pp 179–196

    Google Scholar 

  • Bao F, Chen J (2014) Visual framework for big data in d3.js. In: 2014 IEEE workshop on electronics, computer and applications. IEEE, pp 47–50

    Google Scholar 

  • Batini C, Cappiello C, Francalanci C, Maurino A (2009) Methodologies for data quality assessment and improvement. ACM Comput Surv (CSUR) 41(3):16

    Google Scholar 

  • Bel N, Koster CH, Villegas M (2003) Cross-lingual text categorization. In: ECDL, vol 2769. Springer, pp 126–139

    Google Scholar 

  • Bergamaschi S, Carlini E, Ceci M, Furletti B, Giannotti F, Malerba D, Mezzanzanica M, Monreale A, Pasi G, Pedreschi D et al (2016) Big data research in Italy: a perspective. Engineering 2(2):163–170

    Google Scholar 

  • Biran O, Cotton C (2017) Explanation and justification in machine learning: a survey. In: IJCAI-17 workshop on explainable AI (XAI), p 8

    Google Scholar 

  • Boselli R, Cesarini M, Marrara S, Mercorio F, Mezzanzanica M, Pasi G, Viviani M (2017a) Wolmis: a labor market intelligence system for classifying web job vacancies. J Intell Inf Syst, 1–26. https://doi.org/10.1007/s10844-017-0488-x

  • Boselli R, Cesarini M, Mercorio F, Mezzanzanica M (2017b) Using machine learning for labour market intelligence. In: The European conference on machine learning and principles and practice of knowledge discovery in databases – ECML-PKDD

    Google Scholar 

  • Bostock M, Ogievetsky V, Heer J (2011) D3 data-driven documents. IEEE Trans Vis Comput Graph 17(12):2301–2309

    Google Scholar 

  • CEDEFOP (2010) A new impetus for European cooperation in vocational education and training to support the Europe 2020 strategy (publicly available at https://goo.gl/Goluxo)

  • CEDEFOP (2014) Real-time labour market information on skill requirements: feasibility study and working prototype. CEDEFOP reference number ao/rpa/vkvet-nsofro/real-time lmi/010/14. Contract notice 2014/s 141-252026 of 15 July 2014. https://goo.gl/qNjmrn

  • CEDEFOP (2016) Real-time labour market information on skill requirements: setting up the EU system for online vacancy analysis ao/dsl/vkvet-grusso/real-time lmi 2/009/16. contract notice – 2016/s 134-240996 of 14 July 2016. https://goo.gl/5FZS3E

  • DARPA (2017) Explainable artificial intelligence (XAI). Available at https://www.darpa.mil/program/explainable-artificial-intelligence

  • European Commission (2016a) A new skills agenda for Europe. COM(2016) 381/2

    Google Scholar 

  • European Commission (2016b) Vacancies for ICT online repository 2 (victory 2): data collection. https://goo.gl/3D7qNQ

  • European Commission (2017) ESCO: European skills, competences, qualifications and occupations. Available at https://ec.europa.eu/esco/portal/browse

  • EuroStat (2016) The ESSnet big data project. Available at https://goo.gl/EF6GtU

  • Fayyad U, Piatetsky-Shapiro G, Smyth P (1996) The KDD process for extracting useful knowledge from volumes of data. Commun ACM 39(11):27–34

    Article  Google Scholar 

  • Fox M, Long D, Magazzeni D (2017) Explainable planning. arXiv preprint arXiv:170910256

    Google Scholar 

  • Frey CB, Osborne MA (2017) The future of employment: how susceptible are jobs to computerisation? Technol Forecast Soc Chang 114(Supplement C):254–280. https://doi.org/10.1016/j.techfore.2016. 08.019, http://www.sciencedirect.com/science/article/ pii/S0040162516302244

  • Gosling SD, Vazire S, Srivastava S, John OP (2004) Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. Am Psychol 59(2):93

    Article  Google Scholar 

  • Hong W, Zheng S, Wang H (2013) Dynamic user profile-based job recommender system. In: Computer science & education (ICCSE). IEEE

    Google Scholar 

  • Kokkodis M, Papadimitriou P, Ipeirotis PG (2015) Hiring behavior models for online labor markets. In: Proceedings of the eighth ACM international conference on web search and data mining. ACM, pp 223–232

    Google Scholar 

  • Kureková L, Beblavỳ M, Haita C (2012) Qualifications or soft skills? Studying demand for low-skilled from job advertisements. Technical report, NEUJOBS working paper

    Google Scholar 

  • Li H, Ge Y, Zhu H, Xiong H, Zhao H (2017) Prospecting the career development of talents: a survival analysis perspective. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 917–925

    Google Scholar 

  • Little RJ, Rubin DB (2014) Statistical analysis with missing data. Wiley, New York, USA

    MATH  Google Scholar 

  • Mang C (2012) Online job search and matching quality. Technical report, IFO working paper

    Google Scholar 

  • Mezzanzanica M, Boselli R, Cesarini M, Mercorio F (2015) A model-based evaluation of data quality activities in KDD. Inf Process Manag 51(2):144–166

    Article  Google Scholar 

  • Neculoiu P, Versteegh M, Rotaru M, Amsterdam TB (2016) Learning text similarity with siamese recurrent networks. ACL 2016, p 148

    Google Scholar 

  • Olsson JS, Oard DW, Hajič J (2005) Cross-language text classification. In: Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 645–646

    Google Scholar 

  • Organization IL (2017) ISCO: the international standard classification of occupations. Available at http://www.ilo.org/public/english/bureau/stat/isco/

  • Prettenhofer P, Stein B (2011) Cross-lingual adaptation using structural correspondence learning. ACM Trans Intell Syst Tech (TIST) 3(1):13

    Google Scholar 

  • Redman TC (1998) The impact of poor data quality on the typical enterprise. Commun ACM 41(2):79–82

    Article  Google Scholar 

  • Ribeiro MT, Singh S, Guestrin C (2016) Why should I trust you?: explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1135–1144

    Google Scholar 

  • Sebastiani F (2002) Machine learning in automated text categorization. ACM compu surv (CSUR) 34(1):1–47

    Article  Google Scholar 

  • Shi L, Mihalcea R, Tian M (2010) Cross language text classification by model translation and semi-supervised learning. In: Proceedings of the 2010 conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 1057–1067

    Google Scholar 

  • Singh A, Rose C, Visweswariah K, Chenthamarakshan V, Kambhatla N (2010) Prospect: a system for screening candidates for recruitment. In: Proceedings of the 19th ACM international conference on information and knowledge management. ACM, pp 659–668

    Google Scholar 

  • The European Network on Regional Labour Market Monitoring (2017) Web page (http://www.regionallabourmarketmonitoring.net)

  • UK Commission for Employment and Skills (2015) The importance of LMI. Available at https://goo.gl/TtRwvS

  • UK Department for Education and Skills (2004) LMI Matters!

    Google Scholar 

  • U.S. Department of Labor/Employment & Training Administration (2017) O*net: the occupational information network. Available at https://www.onetcenter.org

  • Vassiliadis P, Simitsis A, Skiadopoulos S (2002) Conceptual modeling for ETL processes. In: Proceedings of the 5th ACM international workshop on data warehousing and OLAP. ACM, pp 14–21

    Google Scholar 

  • Verroios V, Papadimitriou P, Johari R, Garcia-Molina H (2015) Client clustering for hiring modeling in work marketplaces. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 2187–2196

    Google Scholar 

  • Wade MR, Parent M (2002) Relationships between job skills and performance: a study of webmasters. J Manage Inf Syst 18(3):71–96

    Article  Google Scholar 

  • Wang RY, Strong DM (1996) Beyond accuracy: what data quality means to data consumers. J Manage Inf Syst 12(4):5–33

    Article  Google Scholar 

  • Yi X, Allan J, Croft WB (2007) Matching resumes and jobs based on relevance models. In: Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 809–810

    Google Scholar 

  • Zhu C, Zhu H, Xiong H, Ding P, Xie F (2016) Recruitment market trend analysis with sequential latent variable models. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 383–392

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fabio Mercorio .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Mezzanzanica, M., Mercorio, F. (2018). Big Data Enables Labor Market Intelligence. In: Sakr, S., Zomaya, A. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-63962-8_276-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-63962-8_276-1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-63962-8

  • Online ISBN: 978-3-319-63962-8

  • eBook Packages: Springer Reference MathematicsReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Chapter history

  1. Latest

    Big Data Enables Labor Market Intelligence
    Published:
    01 February 2018

    DOI: https://doi.org/10.1007/978-3-319-63962-8_276-1

  2. Original

    Big Data as Fuel of Skill Intelligence
    Published:
    24 February 2012

    DOI: https://doi.org/10.1007/978-3-319-63962-8_276-2