Deep Self-Taught Learning for Detecting Drug Abuse Risk Behavior in Tweets

  • Han Hu
  • NhatHai PhanEmail author
  • James Geller
  • Huy Vo
  • Bhole Manasi
  • Xueqi Huang
  • Sophie Di Lorio
  • Thang Dinh
  • Soon Ae Chun
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11280)


Drug abuse continues to accelerate toward becoming the most severe public health problem in the United States. The ability to detect drug abuse risk behavior at a population scale, such as among the population of Twitter users, can help us to monitor the trend of drug-abuse incidents. Unfortunately, traditional methods do not effectively detect drug abuse risk behavior, given tweets. This is because: (1) Tweets usually are noisy and sparse; and (2) The availability of labeled data is limited. To address these challenging problems, we proposed a deep self-taught learning system to detect and monitor drug abuse risk behaviors in the Twitter sphere, by leveraging a large amount of unlabeled data. Our models automatically augment annotated data: (i) To improve the classification performance, and (ii) To capture the evolving picture of drug abuse on online social media. Our extensive experiment has been conducted on 3 million drug abuse-related tweets with geo-location information. Results show that our approach is highly effective in detecting drug abuse risk behaviors.


Deep learning Self-taught learning Drug abuse Tweets 


  1. 1.
    Aphinyanaphongs, Y., Lulejian, A., Penfold-Brown, D., Bonneau, R., Krebs, P.: Text classification for automatic detection of e-cigarette use and use for smoking cessation from twitter: a feasibility pilot. In: Pacific Symposium on Biocomputing, vol. 21, pp. 480–491 (2016)Google Scholar
  2. 2.
    Bengio, Y.: Learning deep architectures for AI. Found. Trends Mach. Learn. 2(1), 1–127 (2009)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Bettge, A., Roscher, R., Wenzel, S.: Deep self-taught learning for remote sensing image classification. CoRR abs/1710.07096 (2017)Google Scholar
  4. 4.
    Bosley, J.C., et al.: Decoding twitter: surveillance and trends for cardiac arrest and resuscitation communication. Resuscitation 84(2), 206–212 (2013)CrossRefGoogle Scholar
  5. 5.
    Chary, M., Genes, N., McKenzie, A., Manini, A.F.: Leveraging social networks for toxicovigilance. J. Med. Toxicol. 9(2), 184–191 (2013)CrossRefGoogle Scholar
  6. 6.
    Hanson, C.L., Cannon, B., Butron, S., Giraud-Carrier, C.: An exploration of social circles and prescription drug abuse through twitter. J. Med. Internet Res. 15(9), e189 (2013)CrossRefGoogle Scholar
  7. 7.
    Hanson, C.L., Burton, S.H., Giraud-Carrier, C., West, J.H., Barnes, M.D., Hansen, B.: Tweaking and tweeting exploring twitter for nonmedical use of a psychostimulant drug (adderall) among college students. J. Med. Internet Res. 15(4), e62 (2013)CrossRefGoogle Scholar
  8. 8.
    Coloma, P.M., Becker, B., Sturkenboom, M.C.J.M., van Mulligen, E.M., Kors, J.A.: Evaluating social media networks in medicines safety surveillance: two case studies. Drug Saf. 38(10), 921–930 (2015)CrossRefGoogle Scholar
  9. 9.
    Dong, X., Meng, D., Ma, F., Yang, Y.: A dual-network progressive approach to weakly supervised object detection. In: Proceedings of the 2017 ACM on Multimedia Conference, MM 2017, pp. 279–287 (2017)Google Scholar
  10. 10.
    Northern Ireland on Drug Abuse: Overdose death rates, September 15, 2017. National Institute on Drug Abuse, 20 January 2018.
  11. 11.
    Northern Ireland on Drug Abuse: Twitter by the numbers: stats, demographics and fun facts, 2018. Omnicore, 7 March 2018.
  12. 12.
    Ex-DEA Agent: Opioid crisis fueled by drug industry and congress. CBS 60 Minutes, 17 October 2017Google Scholar
  13. 13.
    Gan, J., Li, L., Zhai, Y., Liu, Y.: Deep self-taught learning for facial beauty prediction. Neurocomputing 144, 295–303 (2014)CrossRefGoogle Scholar
  14. 14.
    Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRefGoogle Scholar
  15. 15.
    Hossain, N., Hu, T., Feizi, R., White, A.M., Luo, J., Kautz, H.A.: Precise localization of homes and activities: detecting drinking-while-tweeting patterns in communities. In: ICWSM (2016)Google Scholar
  16. 16.
    Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  17. 17.
    Marino, T.: Withdraws in latest setback for trump’s opioid fight. New York Times, 17 October 2017Google Scholar
  18. 18.
    McNaughton, E.C., Black, R.A., Zulueta, M.G., Budman, S.H., Butler, S.F.: Measuring online endorsement of prescription opioids abuse: an integrative methodology. Pharmacoepidemiol. Drug Saf. 21(10), 1081–1092 (2012)CrossRefGoogle Scholar
  19. 19.
    Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. CoRR abs/1301.3781 (2013)Google Scholar
  20. 20.
    Monitoring the Future: A continuing study of american youth.
  21. 21.
    Myslín, M., Zhu, S.H., Chapman, W., Conway, M.: Using twitter to examine smoking behavior and perceptions of emerging tobacco products. J. Med. Internet Res. 15(8), e174 (2013)CrossRefGoogle Scholar
  22. 22.
    National Institute on Drug Abuse: Gun violence archive, past summary ledgers. (n.d.). Gun Violence Archive, 20 January 2018.
  23. 23.
    National Poisoning Data System: National Poisoning Data System, 16 January 2017.
  24. 24.
    Phan, N., Chun, S.A., Bhole, M., Geller, J.: Enabling real-time drug abuse detection in tweets. In: 2017 IEEE 33rd International Conference on Data Engineering (ICDE), pp. 1510–1514 (2017)Google Scholar
  25. 25.
    Raina, R., Battle, A., Lee, H., Packer, B., Ng, A.Y.: Self-taught learning: transfer learning from unlabeled data. In: Proceedings of the 24th International Conference on Machine Learning, ICML 2007, pp. 759–766 (2007)Google Scholar
  26. 26.
    SAMHSA: Key substance use and mental health indicators in the United States, 2015. SAMHSA (n.d.), 20 January 2018.
  27. 27.
    SAMHSA: Key substance use and mental health indicators in the United States, 2016. SAMHSA (n.d.), 20 January 2018.
  28. 28.
    Sarker, A., et al.: Social media mining for toxicovigilance: automatic monitoring of prescription medication abuse from twitter. Drug Saf. 39(3), 231–240 (2016)CrossRefGoogle Scholar
  29. 29.
    Shutler, L.: Prescription opioids in the twittersphere a contextual analysis of tweets about prescription drugs. Ann. Emerg. Med. 62(4), S122 (2013)CrossRefGoogle Scholar
  30. 30.
    Signorini, A., Segre, A.M., Polgreen, P.M.: The use of twitter to track levels of disease activity and public concern in the U.S. during the influenza a h1n1 pandemic. PLOS ONE 6(5), 1–10 (2011)CrossRefGoogle Scholar
  31. 31.
    Substance Abuse and Mental Health Services Administration Center for Behavioral Health Statistics and Quality (formerly the Office of Applied Studies): The dawn report: highlights of the 2009 drug abuse warning network (dawn) findings on drug-related emergency department visits, 28 December 2010Google Scholar
  32. 32.
    The National Center on Addiction and Substance Abuse: Commonly used illegal drugs, 16 January 2017.
  33. 33.
    US FDA: Medwatch: the FDA safety information and adverse event reporting program, 16 January 2017.
  34. 34.
    Weston, J., Ratle, F., Collobert, R.: Deep learning via semi-supervised embedding. In: Proceedings of the 25th International Conference on Machine Learning, ICML 2008, pp. 1168–1175 (2008)Google Scholar
  35. 35.
    Yuan, Y., Liang, X., Wang, X., Yeung, D., Gupta, A.: Temporal dynamic graph LSTM for action-driven video object detection. CoRR abs/1708.00666 (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Han Hu
    • 1
  • NhatHai Phan
    • 1
    Email author
  • James Geller
    • 1
  • Huy Vo
    • 2
  • Bhole Manasi
    • 1
  • Xueqi Huang
    • 2
  • Sophie Di Lorio
    • 1
  • Thang Dinh
    • 3
  • Soon Ae Chun
    • 4
  1. 1.New Jersey Institute of TechnologyNewarkUSA
  2. 2.The City College of New YorkNew YorkUSA
  3. 3.Virginia Commonwealth UniversityRichmondUSA
  4. 4.City University of New YorkStaten IslandUSA

Personalised recommendations