Skip to main content

Twitter Analytics for Disaster Relevance and Disaster Phase Discovery

  • Conference paper
  • First Online:
Proceedings of the Future Technologies Conference (FTC) 2018 (FTC 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 880))

Included in the following conference series:

Abstract

Natural disasters happen at any time and at any place. Social media can provide an important mean for both people affected and emergency personnel in sharing and receiving relevant information as the disaster unfolds across the different phases of the disaster. Focusing on the phases of preparedness, response and recovery, certain information needs to be retrieved due to the critical mission of emergency personnel. Such information can be directed depending on the disaster phase towards warning citizens, saving lives, or reducing the disaster impact. In this paper, we present an analytical study on Twitter data for three recent major hurricane disasters covering the three main disaster phases of preparedness, response and recovery. Our goal is to identify relevant tweets that will carry important information for disaster phase discovery. To achieve our goal, we propose a cloud-based system framework focused on three main components of disaster relevance classification, disaster phase classification and knowledge extraction. The framework is general enough for the three main disaster phases and specific to a hurricane disaster. Our results show that relevant tweets from different disaster data sets spanning different disaster phases can be classified for relevancy with an accuracy around 0.86, and for disaster phase with an accuracy of 0.85, where key information for disaster management personnel can be extracted.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Tweet object

    https://developer.twitter.com/en/docs/tweets/data-dictionary/overview/tweet-object.

  2. 2.

    Gnip http://support.gnip.com/ .

  3. 3.

    Microsoft Azure Machine Learning Studio

    https://azure.microsoft.com/en-us/services/machine-learning-studio/.

References

  1. Win, S.S.M., Aung, T.N.: Target oriented tweets monitoring system during natural disasters. In: 16th IEEE/ACIS International Conference on Computer and Information Science (ICIS), pp. 143–148. IEEE, Wuhan (2017)

    Google Scholar 

  2. Stowe, K., Paul, M.J., Palmer, M., Palen L., Anderson, K.: Identifying and categorizing disaster-related tweets. In: The Fourth International Workshop on Natural Language Processing for Social Media, pp. 1–6. Association for Computational Linguistics, Austin (2016)

    Google Scholar 

  3. Vieweg, S.E.: Situational awareness in mass emergency: a behavioral and linguistic analysis of microblogged communications. Doctoral dissertation, University of Colorado at Boulder, Boulder, CO (2012)

    Google Scholar 

  4. Ashktorab, Z., Brown, C., Nandi, M., Culotta, A.: Tweedr: mining twitter to inform disaster response. In: Hiltz, S.R., Pfaff, M.S., Plotnick, L., Shih, P.C. (eds.) 11th International ISCRAM Conference, pp. 354–358. The Pennsylvania State University, Pennsylvania (2014)

    Google Scholar 

  5. Imran, M., Castillo C., Lucas J., Meier P., Vieweg, S.: AIDR: artificial intelligence for disaster response. In: 23rd International Conference on World Wide Web, pp. 159–162. ACM, Seoul (2014)

    Google Scholar 

  6. Imran, M., Elbassuoni S., Castillo, C., Diaz, F., Meier, P.: Practical extraction of disaster-relevant information from social media. In: 22nd International Conference on World Wide Web, pp. 1021–1024. ACM, Rio de Janeiro (2013)

    Google Scholar 

  7. Wang, Z., Ye, X.: Social media analytics for natural disaster management. Int. J. Geogr. Inf. Sci. 32(1), 49–72 (2018)

    Article  Google Scholar 

  8. Haworth, B., Bruce, E., Middleton, P.: Emerging technologies for risk reduction: assessing the potential use of social media and VGI for increasing community engagement. Aust. J. Emerg. Manag 30(3), 36 (2015)

    Google Scholar 

  9. Yan, Y., Eckle, M., Kuo, C.L., Herfort, B., Fan, H., Zipf, A.: Monitoring and assessing post-disaster tourism recovery using geotagged social media data. ISPRS Int. J. Geo-Inf. 6(5), 144 (2017)

    Article  Google Scholar 

  10. Habdank, M., Rodehutskors, N., Koch, R.: Relevancy assessment of tweets using supervised learning techniques: mining emergency related tweets for automated relevancy classification. In: 4th International Conference on Information and Communication Technologies for Disaster Management (ICT-DM), pp. 1–8. IEEE, Münster (2017)

    Google Scholar 

  11. Latent Dirichlet Allocation. https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/latent-dirichlet-allocation. Accessed 02 Feb 2018

  12. Anastasopoulos, L.J., Moldogaziev, T.T., Scott, T.A.: Computational Text Analysis for Public Management Research: An Annotated Application to County Budgets (2017)

    Google Scholar 

  13. Huang, Q., Xiao, Y.: Geographic situational awareness: mining tweets for disaster preparedness, emergency response, impact, and recovery. ISPRS Int. J. Geo-Inf. 4(3), 1549–1568 (2015)

    Article  Google Scholar 

  14. Machine learning algorithm cheat sheet for Microsoft Azure machine learning studio. https://docs.microsoft.com/en-us/azure/machine-learning/studio/algorithm-cheat-sheet. Accessed 02 Feb 2018

  15. Spielhofer, T., Greenlaw R., Markham, D., Hahne, A.: Data mining Twitter during the UK floods: investigating the potential use of social media in emergency management. In: 3rd International Conference on Information and Communication Technologies for Disaster Management (ICT-DM), pp. 1–6. IEEE, Vienna (2016)

    Google Scholar 

  16. Named Entity Recognition. https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/named-entity-recognition. Accessed 02 Feb 2018

  17. Extract key phrases from text. https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/extract-key-phrases-from-text. Accessed 02 Feb 2018

Download references

Acknowledgements

Special thanks to Dr. Farnoush Banaei-Kashani, University of Colorado Denver. This work is supported by the Department of Education GAANN Program, Fellowship # P200A150283, focused on Big Data Science and Engineering.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abeer Abdel Khaleq .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Khaleq, A.A., Ra, I. (2019). Twitter Analytics for Disaster Relevance and Disaster Phase Discovery. In: Arai, K., Bhatia, R., Kapoor, S. (eds) Proceedings of the Future Technologies Conference (FTC) 2018. FTC 2018. Advances in Intelligent Systems and Computing, vol 880. Springer, Cham. https://doi.org/10.1007/978-3-030-02686-8_31

Download citation

Publish with us

Policies and ethics