Abstract
Understanding of cause-effect relations is vital for constructing a valid model of a system under development. Discovering cause-effect relations in text is one of the difficult tasks in Natural Language Processing (NLP). This paper presents a survey on trends in this field related to understanding how linguistically causal dependencies can be expressed in the text, what patterns and models exist, which of them are more and less successful and why. The results show that causal dependencies in text can be described using plenty lexical expressions as well as linguistic and syntactic patterns. Moreover, the same constructs can be used for non-causal dependencies. Solutions that combine the patterns, ontologies, temporal models and a use of machine learning demonstrate more accurate results in extracting and selecting cause-effect pairs. However, not all lexical expressions are well studied. There are few researches on multi-cause and multi-effect domains. The results of the survey are to be used for construction of a Topological Functioning Model (TFM) of a system, where cause-effect relations are one of key elements. However, they can be used also for construction of other behavioral models.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Miller, J., Mukerji, J.: Model driven architecture (MDA) (2001)
Khoo, C., Chan, S., Niu, Y.: The many facets of the cause-effect relation. In: Green, R., Bean, C.A., Myaeng, S.H. (eds.) The Semantics of Relationships. ISKM, vol. 3, pp. 51–70. Springer, Dordrecht (2002). https://doi.org/10.1007/978-94-017-0073-3_4
Nazaruka, E.: Meaning of cause-and-effect relations of the topological functioning model in the UML analysis model. In: Proceedings of the 12th International Conference on Evaluation of Novel Approaches to Software Engineering, pp. 336–345. SciTePress - Science and Technology Publications (2017)
Kardoš, M., Drozdová, M.: Analytical method of CIM to PIM transformation in model driven architecture (MDA). J. Inf. Organ. Sci. 34, 89–99 (2010)
Kriouile, A., Gadi, T., Balouki, Y.: CIM to PIM transformation: a criteria based evaluation. Int. J. Comput. Technol. Appl. 4, 616–625 (2013)
Kriouile, A., Addamssiri, N., Gadi, T., Balouki, Y.: Getting the static model of PIM from the CIM. In: 2014 Third IEEE International Colloquium in Information Science and Technology (CIST), pp. 168–173. IEEE, Tetouan (2014)
Kriouile, A., Addamssiri, N., Gadi, T.: An MDA method for automatic transformation of models from CIM to PIM. Am. J. Softw. Eng. Appl. 4, 1–14 (2015). https://doi.org/10.11648/j.ajsea.20150401.11
Bousetta, B., El Beggar, O., Gadi, T.: A methodology for CIM modelling and its transformation to PIM. J. Inf. Eng. Appl. 3, 1–21 (2013)
Rhazali, Y., Hadi, Y., Mouloudi, A.: CIM to PIM transformation in MDA: from service-oriented business models to web-based design models. Int. J. Softw. Eng. Appl. 10, 125–142 (2016). https://doi.org/10.14257/ijseia.2016.10.4.13
Essebaa, I., Chantit, S.: Toward an automatic approach to get PIM level from CIM level using QVT rules. In: 2016 11th International Conference on Intelligent Systems: Theories and Applications (SITA), pp. 1–6. IEEE, Mohammedia (2016)
Osis, J., Donins, U.: Topological UML Modeling: An Improved Approach for Domain Modeling and Software Development. Elsevier, Amsterdam (2017)
Osis, J.: Topological model of system functioning. Autom. Comput. Sci. J. Acad. Sci. 6, 44–50 (1969). (in Russian)
Osis, J., Asnina, E., Grave, A.: Formal computation independent model of the problem domain within the MDA. In: Zendulka, J. (ed.) Proceedings of the 10th International Conference on Information System Implementation and Modeling, Hradec nad Moravicí, Czech Republic, 23–25 April 2007, pp. 47–54. Jan Stefan MARQ (2007)
Osis, J., Asnina, E.: Topological modeling for model-driven domain analysis and software development : functions and architectures. In: Model-Driven Domain Analysis and Software Development: Architectures and Functions, pp. 15–39. IGI Global, Hershey (2011)
Osis, J., Slihte, A.: Transforming textual use cases to a computation independent model. In: Osis, J., Nikiforova, O. (eds.) Model-Driven Architecture and Modeling-Driven Software Development: ENASE 2010, 2nd MDA&MTDD Whs., pp. 33–42. SciTePress (2010)
Slihte, A., Osis, J., Donins, U.: Knowledge integration for domain modeling. In: Osis, J., Nikiforova, O. (eds.) Model-Driven Architecture and Modeling-Driven Software Development: ENASE 2011, 3rd MDA&MDSD Whs., pp. 46–56. SciTePress (2011)
Elstermann, M., Heuser, T.: Automatic tool support possibilities for the text-based S-BPM process modelling methodology. In: Proceedings of the 8th International Conference on Subject-Oriented Business Process Management, S-BPM 2016, pp. 1–8. ACM Press, New York (2016)
Nazaruka, E.: Identification of causal dependencies by using natural language processing: a survey. In: Damian, E., Spanoudakis, G., Maciaszek, L. (eds.) Proceedings of the 14th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: MDI4SE, pp. 603–613. SciTePress (2019)
Osis, J., Asnina, E.: Is modeling a treatment for the weakness of software engineering? In: Model-Driven Domain Analysis and Software Development, pp. 1–14. IGI Global, Hershey (2011)
Asnina, E.: The computation independent viewpoint: a formal method of topological functioning model constructing. Appl. Comput. Syst. 26, 21–32 (2006)
Osis, J., Asnina, E., Grave, A.: MDA oriented computation independent modeling of the problem domain. In: Proceedings of the 2nd International Conference on Evaluation of Novel Approaches to Software Engineering, ENASE 2007, pp. 66–71. INSTICC Press, Barcelona (2007)
Osis, J., Asnina, E., Grave, A.: Formal problem domain modeling within MDA. In: Filipe, J., Shishkov, B., Helfert, M., Maciaszek, L.A. (eds.) ENASE/ICSOFT -2007. CCIS, vol. 22, pp. 387–398. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88655-6_29
Šlihte, A., Osis, J.: The integrated domain modeling: a case study. In: Proceedings of the 11th International Baltic Conference on Databases and Information Systems (DB&IS 2014), pp, 465–470. Tallinn University of Technology Press, Tallinn (2014)
Asnina, E., Ovchinnikova, V.: Specification of decision-making and control flow branching in topological functioning models of systems. In: International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE 2015), pp. 364–373. SciTePress, Barcelona (2015)
Khoo, C., Chan, S., Niu, Y., Ang, A.: A method for extracting causal knowledge from textual databases. Singap. J. Libr. & Inf. Manag. 28, 48–63 (1999)
Solstad, T., Bott, O.: Causality and causal reasoning in natural language. In: Waldmann, M.R. (ed.) The Oxford Handbook of Causal Reasoning. Oxford University Press, Oxford (2017)
Ning, Q., Feng, Z., Wu, H., Roth, D.: Joint reasoning for temporal and causal relations. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Long Papers), pp. 2278–2288. Association for Computational Linguistics, Melbourne (2018)
Altenberg, B.: Causal linking in spoken and written English. Stud. Linguist. 38, 20–69 (1984)
Girju, R.: Automatic detection of causal relations for question answering. In: Proceedings of the ACL 2003 Workshop on Multilingual Summarization and Question Answering, pp. 76–83. Association for Computational Linguistics, Morristown (2003)
Corrigan, R.: Causal attributions to the states and events encoded by different types of verbs. Br. J. Soc. Psychol. 32, 335–348 (1993)
Corrigan, R., Stevenson, C.: Children’s causal attribution to states and events described by different classes of verbs. Cogn. Dev. 9, 235–256 (1994)
Waldmann, M.R., Hagmayer, Y.: Causal reasoning. In: Reisberg, D. (ed.) Oxford Handbook of Cognitive Psychology. Oxford University Press, New York (2013)
Asghar, N.: Automatic extraction of causal relations from natural language texts : a comprehensive survey. CoRR abs/1605.0 (2016)
Mirza, P.: Extracting temporal and causal relations between events. In: Proceedings of the ACL 2014 Student Research Workshop, pp. 10–17. Association for Computational Linguistics, Baltimore (2014)
Mostafazadeh, N., Grealish, A., Chambers, N., Allen, J., Vanderwende, L.: CaTeRS : causal and temporal relation scheme for semantic annotation of event structures. In: Proceedings of the Fourth Workshop on Events, pp. 51–61. Association for Computational Linguistics, San Diego (2016)
Khoo, C.S.G., Kornfilt, J., Oddy, R.N., Myaeng, S.H.: Automatic extraction of cause-effect information from newspaper text without knowledge-based inferencing. Lit. Linguist. Comput. 13, 177–186 (1998)
Hendrickx, I., et al.: SemEval-2010 task 8: multi-way classification of semantic relations between pairs of nominals. In: Proceedings of the 5th International Workshop on Semantic Evaluation, ACL 2010, Uppsala, Sweden, 15–16 July 2010, pp. 33–38. Association for Computational Linguistics (2010)
Sorgente, A., Vettigli, G., Mele, F.: Automatic extraction of cause-effect relations in natural language text. In: Lai, C., Semeraro, G., Giuliani, A. (eds.) Proceedings of the 7th International Workshop on Information Filtering and Retrieval Co-Located with the 13th Conference of the Italian Association for Artificial Intelligence (AI*IA 2013), pp. 37–48 (2013)
Dasgupta, T., Saha, R., Dey, L., Naskar, A.: Automatic extraction of causal relations from text using linguistically informed deep neural networks. In: Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue, pp. 306–316. Association for Computational Linguistics, Stroudsburg (2018)
Mausam, Schmitz, M., Bart, R., Soderland, S., Etzioni, O.: Open language learning for information extraction. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 523–534. Association for Computational Linguistics (2012)
Kang, D., Gangal, V., Lu, A., Chen, Z., Hovy, E.: Detecting and explaining causes from text for a time series event. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pp. 2758–2768. The Association for Computational Linguistics (2017)
Pearl, J.: The seven tools of causal inference, with reflections on machine learning. Commun. Assoc. Comput. Mach. 62, 54–60 (2019). https://doi.org/10.1145/3241036
Blanco, E., Castell, N., Moldovan, D.: Causal relation extraction. In: Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC 2008), pp. 28–30. European Language Resources Association (ELRA) (2008)
Blass, J.A., Forbus, K.D.: Natural language instruction for analogical reasoning : an initial report. In: Workshops Proceedings for the Twenty-Fourth International Conference on Case-Based Reasoning (ICCBR 2016), pp. 21–30 (2016)
Cao, M., Sun, X., Zhuge, H.: The contribution of cause-effect link to representing the core of scientific paper—the role of Semantic Link Network. PLoS ONE 13, 1–14 (2018). https://doi.org/10.1371/journal.pone.0199303
Sorgente, A., Vettigli, G., Mele, F.: A hybrid approach for the automatic extraction of causal relations from text. In: Lai, C., Giuliani, A., Semeraro, G. (eds.) Emerging Ideas on Information Filtering and Retrieval. SCI, vol. 746, pp. 15–29. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-68392-8_2
Mueller, R., Hüttemann, S.: Extracting causal claims from information systems papers with natural language processing for theory ontology learning. In: Proceedings of the 51st Hawaii International Conference on System Sciences (HICSS). IEEE Computer Society Press, Hawaii (2018)
Schneider, G., Winters, J.P.: Applying Use Cases: A practical Guide, 2nd edn. Pearson Education Inc., London (2001)
Leffingwell, D., Widrig, D.: Managing Software Requirements: A Use Case Approach, 2nd edn. Addison-Wesley, Boston (2003)
Elallaoui, M., Nafil, K., Touahni, R.: Automatic transformation of user stories into UML use case diagrams using NLP techniques. Procedia Comput. Sci. 130, 42–49 (2018). https://doi.org/10.1016/j.procs.2018.04.010
Azzazi, A.: A framework using NLP to automatically convert user-stories into use cases in software projects. Int. J. Comput. Sci. Netw. Secur. (IJCSNS) 17, 71–76 (2017)
Lucassen, G., Robeer, M., Dalpiaz, F., van der Werf, J.M.E.M., Brinkkemper, S.: Extracting conceptual models from user stories with Visual Narrator. Requir. Eng. 22, 339–358 (2017). https://doi.org/10.1007/s00766-017-0270-1
Masud, M., Iqbal, M., Khan, M.U., Azam, F.: Automated user story driven approach for web-based functional testing. Int. J. Comput. Inf. Eng. 11, 91–98 (2017)
Robeer, M., Lucassen, G., van der Werf, J.M.E.M., Dalpiaz, F., Brinkkemper, S.: Automated extraction of conceptual models from user stories via NLP. In: 2016 IEEE 24th International Requirements Engineering Conference (RE), pp. 196–205. IEEE (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Nazaruka, E. (2020). An Overview of Ways of Discovering Cause-Effect Relations in Text by Using Natural Language Processing. In: Damiani, E., Spanoudakis, G., Maciaszek, L. (eds) Evaluation of Novel Approaches to Software Engineering. ENASE 2019. Communications in Computer and Information Science, vol 1172. Springer, Cham. https://doi.org/10.1007/978-3-030-40223-5_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-40223-5_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-40222-8
Online ISBN: 978-3-030-40223-5
eBook Packages: Computer ScienceComputer Science (R0)