Interactive Attention Network for Adverse Drug Reaction Classification

  • Ilseyar AlimovaEmail author
  • Valery Solovyev
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 930)


Detection of new adverse drug reactions is intended to both improve the quality of medications and drug reprofiling. Social media and electronic clinical reports are becoming increasingly popular as a source for obtaining the health-related information, such as identification of adverse drug reactions. One of the tasks of extracting adverse drug reactions from social media is the classification of entities that describe the state of health. In this paper, we investigate the applicability of Interactive Attention Network for identification of adverse drug reactions from user reviews. We formulate this problem as a binary classification task. We show the effectiveness of this method on a number of publicly available corpora.


Adverse drug reactions Text mining Natural language processing Health social media analytics Machine learning Deep learning 



This work was supported by the Russian Science Foundation Grant No. 18-11-00284. The authors are grateful to Elena Tutubalina for useful discussions about this study.


  1. 1.
    Alimova, I., Tutubalina, E.: Automated detection of adverse drug reactions from social media posts with machine learning. In: van der Aalst, W. (ed.) AIST 2017. LNCS, vol. 10716, pp. 3–15. Springer, Cham (2018). Scholar
  2. 2.
    Alvaro, N., Miyao, Y., Collier, N.: TwiMed: Twitter and PubMed comparable corpus of drugs, diseases, symptoms, and their relations. JMIR Public Health Surveill. 3(2), e24 (2017)CrossRefGoogle Scholar
  3. 3.
    Aramaki, E., et al.: Extraction of adverse drug effects from clinical records. In: MedInfo, pp. 739–743 (2010)Google Scholar
  4. 4.
    Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: LREC, vol. 10, pp. 2200–2204 (2010)Google Scholar
  5. 5.
    Benton, A., et al.: Identifying potential adverse effects using the web: a new approach to medical hypothesis generation. J. Biomed. Inform. 44(6), 989–996 (2011)CrossRefGoogle Scholar
  6. 6.
    Bian, J., Topaloglu, U., Yu, F.: Towards large-scale Twitter mining for drug-related adverse events. In: Proceedings of the 2012 International Workshop on Smart Health and Wellbeing, pp. 25–32. ACM (2012)Google Scholar
  7. 7.
    Biyani, P., et al.: Co-training over domain-independent and domain-dependent features for sentiment analysis of an online cancer support community. In: Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, pp. 413–417. ACM (2013)Google Scholar
  8. 8.
    Cambria, E., Benson, T., Eckl, C., Hussain, A.: Sentic PROMs: application of sentic computing to the development of a novel unified framework for measuring health-care quality. Expert. Syst. Appl. 39(12), 10533–10543 (2012)CrossRefGoogle Scholar
  9. 9.
    Chowdhury, S., Zhang, C., Yu, P.S.: Multi-task pharmacovigilance mining from social media posts. arXiv preprint arXiv:1801.06294 (2018)
  10. 10.
    Classen, D.C., Pestotnik, S.L., Evans, R.S., Lloyd, J.F., Burke, J.P.: Adverse drug events in hospitalized patients: excess length of stay, extra costs, and attributable mortality. JAMA 277(4), 301–306 (1997)CrossRefGoogle Scholar
  11. 11.
    Dai, H.J., Touray, M., Jonnagaddala, J., Syed-Abdul, S.: Feature engineering for recognizing adverse drug reactions from Twitter posts. Information 7(2), 27 (2016)CrossRefGoogle Scholar
  12. 12.
    Demner-Fushman, D., Chapman, W.W., McDonald, C.J.: What can natural language processing do for clinical decision support? J. Biomed. Inform. 42(5), 760–772 (2009)CrossRefGoogle Scholar
  13. 13.
    Denecke, K., Dolog, P., Smrz, P.: Making use of social media data in public health. In: Proceedings of the 21st International Conference on World Wide Web, pp. 243–246. ACM (2012)Google Scholar
  14. 14.
    Gupta, S., Gupta, M., Varma, V., Pawar, S., Ramrakhiyani, N., Palshikar, G.K.: Co-training for extraction of adverse drug reaction mentions from tweets. In: Pasi, G., Piwowarski, B., Azzopardi, L., Hanbury, A. (eds.) ECIR 2018. LNCS, vol. 10772, pp. 556–562. Springer, Cham (2018). Scholar
  15. 15.
    Harpaz, R., et al.: Text mining for adverse drug events: the promise, challenges, and state of the art. Drug Saf. 37(10), 777–790 (2014)CrossRefGoogle Scholar
  16. 16.
    Hou, Y., Li, X., Wu, G., Ye, X.: National ADR monitoring system in China. Drug Saf. 39(11), 1043–1051 (2016). Scholar
  17. 17.
    Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177. ACM (2004)Google Scholar
  18. 18.
    Huang, B., Ou, Y., Carley, K.M.: Aspect level sentiment classification with attention-over-attention neural networks. arXiv preprint arXiv:1804.06536 (2018)
  19. 19.
    Huynh, T., He, Y., Willis, A., Rüger, S.: Adverse drug reaction classification with deep neural networks. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical papers, pp. 877–887 (2016)Google Scholar
  20. 20.
    Ivanov, V., Tutubalina, E., Mingazov, N., Alimova, I.: Extracting aspects, sentiment and categories of aspects in user reviews about restaurants and cars. In: Proceedings of International Conference Dialog, vol. 2, pp. 22–34 (2015)Google Scholar
  21. 21.
    Karimi, S., Metke-Jimenez, A., Kemp, M., Wang, C.: Cadec: a corpus of adverse drug event annotations. J. Biomed. Inform. 55, 73–81 (2015)CrossRefGoogle Scholar
  22. 22.
    Kiritchenko, S., Mohammad, S.M., Morin, J., de Bruijn, B.: NRC-Canada at SMM4H shared task: classifying tweets mentioning adverse drug reactions and medication intake. arXiv preprint arXiv:1805.04558 (2018)
  23. 23.
    Korkontzelos, I., Nikfarjam, A., Shardlow, M., Sarker, A., Ananiadou, S., Gonzalez, G.H.: Analysis of the effect of sentiment analysis on extracting adverse drug reactions from tweets and forum posts. J. Biomed. Inform. 62, 148–158 (2016)CrossRefGoogle Scholar
  24. 24.
    Lai, S., Xu, L., Liu, K., Zhao, J.: Recurrent convolutional neural networks for text classification. In: AAAI, vol. 333, pp. 2267–2273 (2015)Google Scholar
  25. 25.
    Lazarou, J., Pomeranz, B.H., Corey, P.N.: Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies. JAMA 279(15), 1200–1205 (1998)CrossRefGoogle Scholar
  26. 26.
    Li, H., Min, M.R., Ge, Y., Kadav, A.: A context-aware attention network for interactive question answering. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 927–935. ACM (2017)Google Scholar
  27. 27.
    Liu, F., Yu, H., Jagannatha, A., Liu, W.: NLP challenges for detecting medication and adverse drug events from electronic health records (MADE1.0) (2018).
  28. 28.
    Liu, Q., Zhang, H., Zeng, Y., Huang, Z., Wu, Z.: Content attention model for aspect based sentiment analysis. In: Proceedings of the 2018 World Wide Web Conference on World Wide Web, pp. 1023–1032. International World Wide Web Conferences Steering Committee (2018)Google Scholar
  29. 29.
    Liu, X., Chen, H.: AZDrugMiner: an information extraction system for mining patient-reported adverse drug events in online patient forums. In: Zeng, D. (ed.) ICSH 2013. LNCS, vol. 8040, pp. 134–150. Springer, Heidelberg (2013). Scholar
  30. 30.
    Ma, D., Li, S., Zhang, X., Wang, H.: Interactive attention networks for aspect-level sentiment classification. arXiv preprint arXiv:1709.00893 (2017)
  31. 31.
    Marelli, M., Bentivogli, L., Baroni, M., Bernardi, R., Menini, S., Zamparelli, R.: SemEval-2014 task 1: evaluation of compositional distributional semantic models on full sentences through semantic relatedness and textual entailment. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 1–8 (2014)Google Scholar
  32. 32.
    Melzi, S., Abdaoui, A., Azé, J., Bringay, S., Poncelet, P., Galtier, F.: Patient’s rationale: patient knowledge retrieval from health forums. In: eTELEMED: eHealth, Telemedicine, and Social Medicine (2014)Google Scholar
  33. 33.
    Meng, F., Lu, Z., Li, H., Liu, Q.: Interactive attention for neural machine translation. arXiv preprint arXiv:1610.05011 (2016)
  34. 34.
    Meystre, S., Haug, P.J.: Natural language processing to extract medical problems from electronic clinical documents: performance evaluation. J. Biomed. Inform. 39(6), 589–599 (2006)CrossRefGoogle Scholar
  35. 35.
    Miftahutdinov, Z., Tutubalina, E., Tropsha, A.: Identifying disease-related expressions in reviews using conditional random fields. In: Computational Linguistics and Intellectual Technologies: Papers from the Annual conference “Dialogue”, vol. 1, no. 16, pp. 155–166 (2017).
  36. 36.
    Miranda, D.S.: Automated detection of adverse drug reactions in the biomedical literature using convolutional neural networks and biomedical word embeddings. arXiv preprint arXiv:1804.09148 (2018)
  37. 37.
    Na, J.-C., Kyaing, W.Y.M., Khoo, C.S.G., Foo, S., Chang, Y.-K., Theng, Y.-L.: Sentiment classification of drug reviews using a rule-based linguistic approach. In: Chen, H.-H., Chowdhury, G. (eds.) ICADL 2012. LNCS, vol. 7634, pp. 189–198. Springer, Heidelberg (2012). Scholar
  38. 38.
    Nikfarjam, A., Gonzalez, G.H.: Pattern mining for extraction of mentions of adverse drug reactions from user comments. In: AMIA Annual Symposium Proceedings, vol. 2011, p. 1019. American Medical Informatics Association (2011)Google Scholar
  39. 39.
    Nikfarjam, A., Sarker, A., O’Connor, K., Ginn, R., Gonzalez, G.: Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features. J. Am. Med. Inform. Assoc. 22(3), 671–681 (2015)Google Scholar
  40. 40.
    Niu, Y., Zhu, X., Li, J., Hirst, G.: Analysis of polarity information in medical text. In: AMIA Annual Symposium Proceedings, vol. 2005, p. 570. American Medical Informatics Association (2005)Google Scholar
  41. 41.
    Oliveira, J.L., et al.: The EU-ADR web platform: delivering advanced pharmacovigilance tools. Pharmacoepidemiol. Drug Saf. 22(5), 459–467 (2013)CrossRefGoogle Scholar
  42. 42.
    de la Peña, S., Segura-Bedmar, I., Martínez, P., Martínez, J.L.: ADRSpanishTool: a tool for extracting adverse drug reactions and indications. Procesamiento del Lenguaje Natural 53, 177–180 (2014)Google Scholar
  43. 43.
    Pirmohamed, M., et al.: Adverse drug reactions as cause of admission to hospital: prospective analysis of 18 820 patients. BMJ 329(7456), 15–19 (2004)CrossRefGoogle Scholar
  44. 44.
    Raju, G.S., et al.: Natural language processing as an alternative to manual reporting of colonoscopy quality metrics. Gastrointest. Endosc. 82(3), 512–519 (2015)CrossRefGoogle Scholar
  45. 45.
    Rastegar-Mojarad, M., Elayavilli, R.K., Yu, Y., Liu, H.: Detecting signals in noisy data-can ensemble classifiers help identify adverse drug reaction in tweets. In: Proceedings of the Social Media Mining Shared Task Workshop at the Pacific Symposium on Biocomputing (2016)Google Scholar
  46. 46.
    Rodrigues, R.G., das Dores, R.M., Camilo-Junior, C.G., Rosa, T.C.: SentiHealth-cancer: a sentiment analysis tool to help detecting mood of patients in online social networks. Int. J. Med. Inform. 85(1), 80–95 (2016)CrossRefGoogle Scholar
  47. 47.
    Rusnachenko, N., Loukachevitch, N.: Using convolutional neural networks for sentiment attitude extraction from analytical texts. In: Proceedings of CEUR Workshop, CLLS-2018 Conference. (2018)Google Scholar
  48. 48.
    Salas-Zárate, M.D.P., Medina-Moreira, J., Lagos-Ortiz, K., Luna-Aveiga, H., Rodríguez-García, M.Á., Valencia-García, R.: Sentiment analysis on tweets about diabetes: an aspect-level approach. Comput. Math. Methods Med. 2017, 9 (2017)CrossRefGoogle Scholar
  49. 49.
    Sarker, A., et al.: Utilizing social media data for pharmacovigilance: a review. J. Biomed. Inform. 54, 202–212 (2015)CrossRefGoogle Scholar
  50. 50.
    Sarker, A., Gonzalez, G.: Portable automatic text classification for adverse drug reaction detection via multi-corpus training. J. Biomed. Inform. 53, 196–207 (2015)CrossRefGoogle Scholar
  51. 51.
    Sboev, A., Litvinova, T., Voronina, I., Gudovskikh, D., Rybka, R.: Deep learning network models to categorize texts according to author’s gender and to identify text sentiment. In: 2016 International Conference on Computational Science and Computational Intelligence (CSCI), pp. 1101–1106. IEEE (2016)Google Scholar
  52. 52.
    Serrano-Guerrero, J., Olivas, J.A., Romero, F.P., Herrera-Viedma, E.: Sentiment analysis: a review and comparative analysis of web services. Inf. Sci. 311, 18–38 (2015)CrossRefGoogle Scholar
  53. 53.
    Shareef, S., Naidu, C., Raikar, S.R., Rao, Y.V., Devika, U.: Development, implementation, and analysis of adverse drug reaction monitoring system in a rural tertiary care teaching hospital in Narketpally, Telangana. Int. J. Basic Clin. Pharmacol. 4(4), 757–760 (2017)Google Scholar
  54. 54.
    Singh, P., Agrawal, M., Hishikar, R., Joshi, U., Maheshwari, B., Halwai, A.: Adverse drug reactions at adverse drug reaction monitoring center in Raipur: analysis of spontaneous reports during 1 year. Indian J. Pharmacol. 49(6), 432 (2017)CrossRefGoogle Scholar
  55. 55.
    Sokolova, M., Matwin, S., Jafer, Y., Schramm, D.: How Joe and Jane tweet about their health: mining for personal health information on Twitter. In: Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2013, pp. 626–632 (2013)Google Scholar
  56. 56.
    Solovyev, V., Ivanov, V.: Dictionary-based problem phrase extraction from user reviews. In: Sojka, P., Horák, A., Kopeček, I., Pala, K. (eds.) TSD 2014. LNCS (LNAI), vol. 8655, pp. 225–232. Springer, Cham (2014). Scholar
  57. 57.
    Wang, B., Liu, K., Zhao, J.: Inner attention based recurrent neural networks for answer selection. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol. 1, pp. 1288–1297 (2016)Google Scholar
  58. 58.
    Wilson, T., Wiebe, J., Hoffmann, P.: Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, pp. 347–354. Association for Computational Linguistics (2005)Google Scholar
  59. 59.
    Xu, H., Anderson, K., Grann, V.R., Friedman, C.: Facilitating cancer research using natural language processing of pathology reports. In: Studies in Health Technology and Informatics (2004)Google Scholar
  60. 60.
    Yang, M., Qu, Q., Chen, X., Guo, C., Shen, Y., Lei, K.: Feature-enhanced attention network for target-dependent sentiment classification. Neurocomputing 307, 91–97 (2018)CrossRefGoogle Scholar
  61. 61.
    Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1480–1489 (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Kazan (Volga Region) Federal UniversityKazanRussia

Personalised recommendations