A Multi-label Active Learning Approach for Mobile App User Review Classification

  • Montassar Ben Messaoud
  • Ilyes JenhaniEmail author
  • Nermine Ben Jemaa
  • Mohamed Wiem Mkaouer
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11775)


User reviews of mobile applications convey useful feedback from users, e.g. feature requests, bug descriptions, etc. The increasing number of reviews that users submit daily makes it difficult for developers to manually analyze and classify them into proper review categories. Moreover, several review messages may contain more than one information. In this paper, we propose to use multi-label active learning as a convenient solution to the problem of mobile app user reviews classification. An unlabeled and structured dataset was built from the initially unstructured large set of review messages. Moreover, in order to reduce the effort needed to assign labels to each instance in the large constructed dataset, we opted for an Active Learning approach. Experimental results have shown that, by actively querying an oracle for labels during training a binary relevance-based classifier (with logistic regression as a base classifier), we obtained a classifier that outperformed well-known classifiers in terms of performance without the need to label the whole dataset.


  1. 1.
    Guzman, E., El-Haliby, M., Bruegge, B.: Ensemble methods for app review classification: an approach for software evolution (N). In: 30th IEEE/ACM International Conference on Automated Software Engineering, pp. 771–776 (2015)Google Scholar
  2. 2.
    Zhang, L., Huang, X., Jiang, J., Hu, Y.: CSLabel: an approach for labelling mobile app reviews. J. Comput. Sci. Technol. 32(6), 1076–1089 (2017)CrossRefGoogle Scholar
  3. 3.
    Palomba, F., et al.: Crowdsourcing user reviews to support the evolution of mobile apps. J. Syst. Softw. 137, 143–162 (2018)CrossRefGoogle Scholar
  4. 4.
    Bird, S., Klein, E., Loper, E.: Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit. O’Reilly Media Inc., Sebastopol (2009)zbMATHGoogle Scholar
  5. 5.
    Herrera, F., Charte, F., Rivera, A.J., del Jesus, M.J.: Multilabel Classification - Problem Analysis, Metrics and Techniques. Springer, Cham (2016). Scholar
  6. 6.
    Settles, B.: Active learning literature survey. University of Wisconsin-Madison, Computer Sciences Technical report 1648 (2009)Google Scholar
  7. 7.
    Deocadez, R., Harrison, R., Rodríguez, D.: Automatically classifying requirements from app stores: a preliminary study. In: IEEE 25th International Requirements Engineering Conference Workshops, pp. 367–371 (2017)Google Scholar
  8. 8.
    Maalej, W., Kurtanovic, Z., Nabil, H., Stanik, C.: On the automatic classification of app reviews. Requirements Eng. 21(3), 311–331 (2016)CrossRefGoogle Scholar
  9. 9.
    Vasa, R., Hoon, L., Mouzakis, K., Noguchi, A.: A preliminary analysis of mobile app user reviews. In: Proceedings of the 24th Australian Computer-Human Interaction Conference, pp. 241–244 (2012)Google Scholar
  10. 10.
    Yang, Y., Lee, S., Chung, Y., Wu, T., Chen, S., Lin, H.: libact: pool-based active learning in python, vol. 6. CoRR (2017)Google Scholar
  11. 11.
    Hung, C.-W., Lin, H.-T.: Multi-label active learning with auxiliary learner. In: Asian Conference on Machine Learning, pp. 315–332 (2011)Google Scholar
  12. 12.
    Tai, F., Lin, H.-T.: Multilabel classification with principal label space transformation. Neural Comput. 24(9), 2508–2542 (2012)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Zhang, M.-L., Zhou, Z.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819–1837 (2014)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Montassar Ben Messaoud
    • 1
  • Ilyes Jenhani
    • 2
    Email author
  • Nermine Ben Jemaa
    • 1
  • Mohamed Wiem Mkaouer
    • 3
  1. 1.LARODEC, ISG TunisBardoTunisia
  2. 2.College of Computer Engineering and SciencePrince Mohammad Bin Fahd UniversityKhobarKingdom of Saudi Arabia
  3. 3.Rochester Institute of TechnologyRochesterUSA

Personalised recommendations