Skip to main content
SpringerLink
Log in

5W1H-Based Semantic Segmentation of Tweets for Event Detection Using BERT

  • Conference paper
  • First Online:
Machine Learning, Image Processing, Network Security and Data Sciences (MIND 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1240))

Abstract

Detection of events from Twitter has been one of the significant areas in the Text Mining domain due to the volume of content generated by online users. Twitter is considered as one of the top sources for disseminating information to the users. Due to the short length of texts on Twitter, the content generated is often noisy, which makes the detection of events very difficult. Though research on Twitter event detection has been in existence, most of them focused on implementing statistical measures rather than exploiting the semantics. The work presented in this paper presents an approach for the semantic segmentation of Twitter texts (tweets) by adopting the concept of 5W1H (Who, What, When, Where, Why and How). 5W1H represent the semantic constituents (subject, object and modifiers) of a sentence and the actions of verbs on them. The relationship between a verb and the semantic constituents of a sentence forms the basis for representation of an event. The basic approach of the proposed system is to segment the tweets based on the 5W1H contextual word embeddings generated with the help of recent state-of-the-art technology and then clustering the tweets for the representation of possible events. We compared our approach with a simple baseline system that does not segment the tweets. We evaluated the performance of both the approaches by measuring the cosine similarity of the tweets under a cluster. Our 5W1H segmentation approach produced a similarity score above 82% for the most similar tweets in a cluster against the baseline system that scored below 70%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.internetlivestats.com/.

  2. 2.

    https://bit.ly/37GtJWl.

  3. 3.

    http://verbs.colorado.edu/propbank/framesets-english-aliases/act.html.

  4. 4.

    https://scikit-learn.org/stable/modules/clustering.html#clustering-performance-evaluation.

  5. 5.

    https://en.wikipedia.org/wiki/Silhouette_(clustering).

  6. 6.

    https://en.wikipedia.org/wiki/2016_Indian_banknote_demonetisation.

  7. 7.

    https://en.wikipedia.org/wiki/2016_United_States_presidential_election.

  8. 8.

    https://en.wikipedia.org/wiki/Me_Too_movement_(India).

  9. 9.

    https://en.wikipedia.org/wiki/Sina_Weibo.

References

  1. Kwak, H., Lee, C., Park, H., Moon, S.: What is Twitter, a social network or a news media? In: WWW, pp. 591–600. ACM, Raleigh (2010)

    Google Scholar 

  2. James, A.: Topic Detection and Tracking: Event-Based Information Organization, 1st edn. Springer, Boston (2002). https://doi.org/10.1007/978-1-4615-0933-2

    Book  MATH  Google Scholar 

  3. Becker, H., Naaman, M., Gravano, L.: Beyond trending topics: real-world event identification on Twitter. In: Proceedings of the Fifth International Conference on Weblogs and Social Media, Barcelona, Catalonia, Spain, 17–21 July 2011 (2011)

    Google Scholar 

  4. Dou, W., Wang, K., Ribarsky, W., et al.: Event detection in social media data. In: Proceedings of the IEEE VisWeek Workshop on Interactive Visual Text Analytics - Task Driven Analytics of Social Media Content, pp. 971–980 (2012)

    Google Scholar 

  5. Hasan, M., Orgun, M.A., Schwitter, R.: A survey on real-time event detection from the Twitter data stream. Inf. Sci. 44(4), 443–463 (2017)

    Article  Google Scholar 

  6. Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes Twitter users: real-time event detection by social sensors. In: WWW, pp. 851–860 (2010)

    Google Scholar 

  7. Wilson, T., Medine, P.: The Art of Rhetoric (1560): G - Reference Information and Interdisciplinary Subjects Series. Pennsylvania State University Press (1999)

    Google Scholar 

  8. Chakma, K., Das, A., Debbarma, S.: Deep semantic role labeling for tweets using 5W1H: Who, What, When, Where, Why and How. Computación y Sistemas 23(3), 751–763 (2019). https://doi.org/10.13053/CyS-23-3-3253

    Article  Google Scholar 

  9. Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: Proceedings of the ICLR Conference, San Diego, USA, pp. 1–15 (2015)

    Google Scholar 

  10. Gildea, D., Jurafsky, D.: Automatic labeling of semantic roles. Assoc. Comput. Linguist. 28(3), 245–288 (2002)

    Article  Google Scholar 

  11. Palmer, M., Gildea, D., Kingsbury, P.: The proposition bank: a corpus annotated with semantic roles. Comput. Linguist. J. 31(1), 71–105 (2005)

    Article  Google Scholar 

  12. Baker, C.F., Fillmore, C.J., Lowe, J.B.: The Berkeley framenet project. In: 1998 Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, vol. 1, pp. 86–90 (1998)

    Google Scholar 

  13. Schuler, K.K., Palmer, M.S.: VerbNet: abroad-coverage, comprehensive verb lexicon. Ph.D. thesis. University of Pennsylvania, Philadelphia, PA, USA (2005)

    Google Scholar 

  14. Zhao, Z., Sun, J., Mao, Z., Feng, S., Bao, Y.: Determining the topic hashtags for Chinese microblogs based on 5W model. In: Wang, Y., Yu, G., Zhang, Y., Han, Z., Wang, G. (eds.) BigCom 2016. LNCS, vol. 9784, pp. 55–67. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42553-5_5

    Chapter  Google Scholar 

  15. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, vol. 26 (2013)

    Google Scholar 

  16. Pennington, J., Socher, R., Manning, C.D.: GloVe: global vectors for word representation. In: Empirical Methods in Natural Language Processing, pp. 1532–1543 (2014)

    Google Scholar 

  17. Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

  18. Jin, X., Han, J.: K-means clustering. In: Sammut, C., Webb, G.I. (eds.) Encyclopedia of Machine Learning. Springer, Boston (2011). https://doi.org/10.1007/978-0-387-30164-8_425

    Chapter  Google Scholar 

  19. Jin, X., Han, J.: TF-IDF. In: Sammut, C., Webb, G.I. (eds.) Encyclopedia of Machine Learning. Springer, Boston (2011). https://doi.org/10.1007/978-0-387-30164-8_832

    Chapter  Google Scholar 

  20. Vaswani, A., et al.: Attention is all you need. CoRR, (abs/1706.03762) (2017)

    Google Scholar 

  21. Xiao, H.: BERT-as-service (2018). https://github.com/hanxiao/bert-as-service

  22. Dudoit, S., Fridlyand, J.: A prediction-based resampling method for estimating the number of clusters in a dataset. Genome Biol. 3(7), 1–21 (2002). https://doi.org/10.1186/gb-2002-3-7-research0036

    Article  Google Scholar 

  23. Thalamuthu, A., Mukhopadhyay, I., Zheng, X., Tseng, G.C.: Evaluation and comparison of gene clustering methods in microarray analysis. Bioinformatics 22(19), 2405–2412 (2006)

    Article  Google Scholar 

  24. Reimers, N., Gurevych, I.: Sentence-BERT: sentence embeddings using siamese BERT-networks. In: Proceedings of Empirical Methods in Natural Language Processing. Association for Computational Linguistics (2019). http://arxiv.org/abs/1908.10084

  25. Maaten, L., Hinton, G.: Visualizing data using t-SNE (2008)

    Google Scholar 

  26. Atefeh, F., Khreich, W.: A survey of techniques for event detection in Twitter. Comput. Intell. 31, 132–164 (2015)

    Article  MathSciNet  Google Scholar 

  27. Li, C., Sun, A., Datta, A.: Twevent: segment-based event detection from tweets. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management, CIKM 2012, New York, NY, USA, pp. 155–164 (2012)

    Google Scholar 

  28. Morabia, K., Murthy, B., Lalita, N., Malapati, A., Samant, S.: SEDTWik: segmentation-based event detection from tweets using Wikipedia. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop, pp. 77–85 (2019)

    Google Scholar 

  29. Dabiri, S., Heaslip, K.: Developing a Twitter-based traffic event detection model using deep learning architectures. Expert Syst. Appl. 118, 425–439 (2019)

    Article  Google Scholar 

  30. Sherstinsky, A.: Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network. CoRR, (abs/1808.03314) (2018)

    Google Scholar 

  31. Yamashita, R., Nishio, M., Do, R.K.G., Togashi, K.: Convolutional neural networks: an overview and application in radiology. Insights Imaging 9(4), 611–629 (2018). https://doi.org/10.1007/s13244-018-0639-9

    Article  Google Scholar 

  32. Hasan, M., Orgun, M.A., Schwitter, R.: Real-time event detection from the Twitter data stream using the TwitterNews+ Framework. Inf. Process. Manag. 56(3), 1146–1165 (2019)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. National Institute of Technology Agartala, Agartala, 799046, Tripura, India

    Kunal Chakma, Steve Durairaj Swamy & Swapan Debbarma

  2. Wipro AI Lab, Bangalore, India

    Amitava Das

Authors
  1. Kunal Chakma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Steve Durairaj Swamy
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amitava Das
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Swapan Debbarma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kunal Chakma .

Editor information

Editors and Affiliations

  1. National Institute of Technology Silchar, Silchar, India

    Arup Bhattacharjee

  2. National Institute Of Technology Silchar, Silchar, India

    Samir Kr. Borgohain

  3. National Institute of Technology Silchar, Silchar, India

    Badal Soni

  4. National Institute of Technology Kurukshetra, Kurukshetra, India

    Gyanendra Verma

  5. University of Eastern Finland, Kuopio, Finland

    Xiao-Zhi Gao

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chakma, K., Swamy, S.D., Das, A., Debbarma, S. (2020). 5W1H-Based Semantic Segmentation of Tweets for Event Detection Using BERT. In: Bhattacharjee, A., Borgohain, S., Soni, B., Verma, G., Gao, XZ. (eds) Machine Learning, Image Processing, Network Security and Data Sciences. MIND 2020. Communications in Computer and Information Science, vol 1240. Springer, Singapore. https://doi.org/10.1007/978-981-15-6315-7_5

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-6315-7_5

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-6314-0

  • Online ISBN: 978-981-15-6315-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation