Sentiment Analysis of Tweets by Convolution Neural Network with L1 and L2 Regularization

  • Abhilasha RangraEmail author
  • Vivek Kumar Sehgal
  • Shailendra Shukla
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 955)


Twitter data is one of the largest amounts of data where thousands of tweets are generated by the Twitter user. As this text is dynamic and huge so, we can consider it as a big data or a common example of Big data. The biggest challenge in the analysis of this big data is its improvement in the analysis. In this paper, there is an analysis by using semantic features like bigram, tri-gram and allow to learn by convolution neural network L1 and L2 regularization. Regularization is used to overcome the dropout and increase the training accuracy. In our experimental analysis, we demonstrated the effectiveness of a number of tweets in term of accuracy. In the result, we do not obtain any specific pattern but average improvement in the accuracy. For the analysis, we use 10 cross-validations and used to compare the outcome with max-entropy and SVM. Here we also analyze the effect of convolution layer on accuracy and time of execution.


CNN Tweets Bigdata Regularization n-gram 


  1. 1.
    Go, A., Bhayani, R., Huang, L.: Twitter sentiment classification using distant supervision. CS224 N Project Report, Stanford 1, 12 (2009)Google Scholar
  2. 2.
    Agarwal, A., et al.: Sentiment analysis of twitter data. In: Proceedings of the Workshop on Languages in Social Media. Association for Computational Linguistics (2011)Google Scholar
  3. 3.
    Kouloumpis, E., Wilson, T., Moore, J.D.: Twitter sentiment analysis: the good the bad and the omg! Icwsm 11(538-541), 164 (2011)Google Scholar
  4. 4.
    Bakliwal, A., et al.: Mining sentiments from tweets. In: Proceedings of the 3rd Workshop in Computational Approaches to Subjectivity and Sentiment Analysis (2012)Google Scholar
  5. 5.
    Singh, V., Dubey, S.K.: Opinion mining and analysis: a literature review. In: 2014 IEEE 5th International Conference Confluence The Next Generation Information Technology Summit (Confluence) (2014)Google Scholar
  6. 6.
    Bobicev, V., Sokolova, M., Jafer, Y., Schramm, D.: Learning sentiments from tweets with personal health ınformation. In: Kosseim, L., Inkpen, D. (eds.) AI 2012. LNCS (LNAI), vol. 7310, pp. 37–48. Springer, Heidelberg (2012). Scholar
  7. 7.
    Rosenthal, S., Farra, N., Nakov, P.: SemEval-2017 task 4: sentiment analysis in Twitter. In: Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) (2017)Google Scholar
  8. 8.
    Poursepanj, H., Weissbock, J., Inkpen, D.: uOttawa: system description for SemEval 2013 task 2 sentiment analysis in twitter. In: Second Joint Conference on Lexical and Computational Semantics (* SEM), Volume 2: Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013), vol. 2 (2013)Google Scholar
  9. 9.
    Patil, H.P., and Mohammad A.: Applications, issues and challenges in sentiment analysis and opinion mining–a user’s perspective. Int. J. Cont. Theory App. 10 (2017)Google Scholar
  10. 10.
    Meral, M., Diri, B.: Sentiment analysis on Twitter. In: 2014 22nd. IEEE Signal Processing and Communications Applications Conference (SIU) (2014)Google Scholar
  11. 11.
    Bhuta, S., et al.: A review of techniques for sentiment analysis Of Twitter data. In: IEEE 2014 International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT) (2014)Google Scholar
  12. 12.
    Das, T.K., Acharjya, D.P., Patra, M.R.: Opinion mining about a product by analyzing public tweets in Twitter. In: 2014 International Conference on IEEE Computer Communication and Informatics (ICCCI) (2014)Google Scholar
  13. 13.
    Gokulakrishnan, B., et al.: Opinion mining and sentiment analysis on a twitter data stream. In: 2012 International Conference on IEEE Advances in ICT for Emerging Regions (ICTer) (2012)Google Scholar
  14. 14.
    Poria, S., et al.: Convolutional MKL based multimodal emotion recognition and sentiment analysis. In: IEEE 16th International Conference on Data Mining (ICDM) 2016. IEEE (2016)Google Scholar
  15. 15.
    Ouyang, Xi, et al.: Sentiment analysis using convolutional neural network. In: 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing (CIT/IUCC/DASC/PICOM). IEEE (2015)Google Scholar
  16. 16.
    Saif, H., He, Y., Alani, H.: Semantic sentiment analysis of Twitter. In: Cudré-Mauroux, P., et al. (eds.) ISWC 2012. LNCS, vol. 7649, pp. 508–524. Springer, Heidelberg (2012). Scholar
  17. 17.
    Martin, S., Liermann, J., Ney, H.: Algorithms for bigram and trigram word clustering1. Speech Commun. 24(1), 19–37 (1998)CrossRefGoogle Scholar
  18. 18.
    You, Q., et al.: Robust image sentiment analysis using progressively trained and domain transferred deep networks. In: AAAI (2015)Google Scholar
  19. 19.
    Singhal, P., Bhattacharyya, P.: Sentiment analysis and deep learning: a survey. (2016)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Abhilasha Rangra
    • 1
    Email author
  • Vivek Kumar Sehgal
    • 1
  • Shailendra Shukla
    • 1
  1. 1.Department of Computer Science and EngineeringJaypee University of Information TechnologyWakhnaghatIndia

Personalised recommendations