Skip to main content

Language Identification as Process Prediction Using WoMan

  • Conference paper
  • First Online:
Digital Libraries and Archives (IRCDL 2017)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 733))

Included in the following conference series:

  • 459 Accesses

Abstract

Several high-level tasks in the management of Digital Libraries require the application of Natural Language Processing (NLP) techniques. In turn, most NLP solutions are based on linguistic resources that are costly to produce, and so motivate research for automated ways to build them. In particular, Language Identification is a crucial NLP task, that is preliminary to almost all the others, since different linguistic resources must be used for different languages. This paper investigates process mining and management approaches as a possible solution to the Language Identification problem. Specifically, it casts language identification as a process prediction task, and exploits the WoMan framework to carry it out. Experimental results are encouraging and suggest to further explore this approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ahmed, B., Cha, S.H., Tappert, C.: Language identification from text using n-gram based cumulative frequency addition. In: Proceedings of Student/Faculty Research Day, p. 12-1. CSIS, Pace University (2004)

    Google Scholar 

  2. Brown, P.F., deSouza, P.V., Mercer, R.L., Pietra, V.J.D., Lai, J.C.: Class-based n-gram models of natural language. Comput. Linguist. 18(4), 467–479 (1992)

    Google Scholar 

  3. Cavnar, W.B., Trenkle, J.M.: N-gram-based text categorization. In: Proceedings of 3rd Annual Symposium on Document Analysis and Information Retrieval (SDAIR 1994), pp. 161–175 (1994)

    Google Scholar 

  4. Ferilli, S.: WoMan: logic-based workflow learning and management. IEEE Trans. Syst. Man Cybern. Syst. 44, 744–756 (2014)

    Article  Google Scholar 

  5. Ferilli, S., Esposito, F.: A logic framework for incremental learning of process models. Fundamenta Informaticae 128, 413–443 (2013)

    MathSciNet  MATH  Google Scholar 

  6. Ferilli, S., Esposito, F., Grieco, D.: Automatic learning of linguistic resources for stopword removal and stemming from text. Procedia Comput. Sci. 38(C), 116–123 (2014)

    Article  Google Scholar 

  7. Ferilli, S.: The WoMan formalism for expressing process models. In: Perner, P. (ed.) ICDM 2016. LNCS, vol. 9728, pp. 363–378. Springer, Cham (2016). doi:10.1007/978-3-319-41561-1_27

    Chapter  Google Scholar 

  8. Ferilli, S.: Natural language processing. In: Ferilli, S. (ed.) Automatic Digital Document Processing. Advances in Pattern Recognition, pp. 131–155. Springer, Cham (2015). doi:10.1007/978-0-85729-198-1_6

    Google Scholar 

  9. van der Aalst, W., et al.: Process mining manifesto. In: Daniel, F., Barkaoui, K., Dustdar, S. (eds.) BPM 2011. LNBIP, vol. 99, pp. 169–194. Springer, Heidelberg (2012). doi:10.1007/978-3-642-28108-2_19

    Chapter  Google Scholar 

  10. Jozefowicz, R., Vinyals, O., Schuster, M., Shazeer, N., Wu, Y.: Exploring the limits of language modeling (2016)

    Google Scholar 

  11. Martins, B., Silva, M.: Language identification in web pages. In: Proceedings of the 2005 ACM symposium on Applied Computing, pp. 764–768. ACM (2005)

    Google Scholar 

  12. Mathew, T.: Text categorization using n-grams and hidden Markov models (2006). http://www.slideshare.net/thomas_a_mathew/text-categorization-using-ngrams-and-hiddenmarkovmodel

  13. Messito, A.: Cuntame nnu cuntu! PhotoCity (2014)

    Google Scholar 

  14. Muggleton, S.: Inductive logic programming. New Gener. Comput. 8(4), 295–318 (1991)

    Article  MATH  Google Scholar 

  15. Nagarajan, T., Murthy, H.: Language identification using parallel syllable like unit recognition. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2004), vol. 1, p. I-401. IEEE (2004)

    Google Scholar 

  16. Pesic, M., van der Aalst, W.M.P.: A declarative approach for flexible business processes management. In: Eder, J., Dustdar, S. (eds.) BPM 2006. LNCS, vol. 4103, pp. 169–180. Springer, Heidelberg (2006). doi:10.1007/11837862_18

    Chapter  Google Scholar 

  17. Pierce, J.: Symbols, Signals and Noise: The Nature and Process of Communication. Harper, New York (1961)

    Google Scholar 

  18. Rotella, F., Leuzzi, F., Ferilli, S.: Learning and exploiting concept networks with connektion. Appl. Intell. 42(1), 87–111 (2015)

    Article  Google Scholar 

  19. Sibun, P., Reynar, J.C.: Language identification: examining the issues (1996)

    Google Scholar 

  20. Vatanen, T., Väyrynen, J.J., Virpioja, S.: Language identification of short text segments with n-gram models. In: Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC 2010). European Language Resources Association (ELRA), Valletta, May 2010

    Google Scholar 

  21. Weijters, A., van der Aalst, W.: Rediscovering workflow models from event-based data. In: Proceedings of the 11th Dutch-Belgian Conference of Machine Learning (Benelearn 2001), pp. 93–100 (2001)

    Google Scholar 

Download references

Acknowledgments

This work was partially funded by the Italian PON 2007–2013 project PON02_00563_3489339 ‘Puglia@Service’.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stefano Ferilli .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Ferilli, S., Esposito, F., Redavid, D., Angelastro, S. (2017). Language Identification as Process Prediction Using WoMan. In: Grana, C., Baraldi, L. (eds) Digital Libraries and Archives. IRCDL 2017. Communications in Computer and Information Science, vol 733. Springer, Cham. https://doi.org/10.1007/978-3-319-68130-6_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-68130-6_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-68129-0

  • Online ISBN: 978-3-319-68130-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics