Advertisement

Extraction of Product Evaluation Factors with a Convolutional Neural Network and Transfer Learning

  • Younghoon Lee
  • Minki Chung
  • Sungzoon Cho
  • Jinhae Choi
Article
  • 26 Downloads

Abstract

Earlier studies have indicated that decision-making by a project development team can be improved throughout the design and development process by understanding the key factors that affect customers evaluations of a new product. Aspect extraction could thus be a useful tool for identifying important attributes when evaluating products or services. Aspect extraction based on deep convolutional neural networks has recently been suggested, demonstrating state-of-the-art performance when applied to a customer review of electronic devices. However, this approach is unsuited to the rapidly evolving smartphone industry, which involves a wide range of product lines. Whereas the previous approach required significant amounts of data labeling for each product, we propose a variant of that approach that includes transfer learning. We also propose a novel approach for transferring the architecture sequentially within the product group. The results indicate that the principal key feature of each product is extracted effectively by the proposed method without having to re-train the entire convolutional neural network model. Furthermore, the proposed method performs better than the previous method for each product line.

Keywords

Product evaluation factor Aspect extraction Convolutional neural network Transfer learning Off-the-shelf features Domain adaptation 

Notes

Acknowledgements

We are very grateful to LG Electronics for having provided us with the customer-review dataset used in our comparison experiments.

References

  1. 1.
    Andrzejewski D, Zhu X, Craven M (2009) Incorporating domain knowledge into topic modeling via dirichlet forest priors. In: Proceedings of the 26th annual international conference on machine learning. ACM, pp 25–32Google Scholar
  2. 2.
    Blitzer J, Dredze M, Pereira F et al (2007) Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. In: ACL, vol 7. pp 440–447Google Scholar
  3. 3.
    Brody S, Elhadad N (2010) An unsupervised aspect-sentiment model for online reviews. In: Human language technologies: the 2010 annual conference of the North American chapter of the association for computational linguistics. Association for Computational Linguistics, pp 804–812Google Scholar
  4. 4.
    Chen Z, Mukherjee A, Liu B, Hsu M, Castellanos M, Ghosh R (2013) Exploiting domain knowledge in aspect extraction. In: Emnlp, pp 1655–1667Google Scholar
  5. 5.
    Choi Y, Cardie C (2010) Hierarchical sequential learning for extracting opinions and their attributes. In: Proceedings of the ACL 2010 conference short papers. Association for Computational Linguistics, pp 269–274Google Scholar
  6. 6.
    Federici M, Dragoni M (2016) Towards unsupervised approaches for aspects extraction. In: EMSA-RMed@ ESWCGoogle Scholar
  7. 7.
    Fuchs C, Prandelli E, Schreier M (2010) The psychological effects of empowerment strategies on consumers’ product demand. J Mark 74(1):65–79CrossRefGoogle Scholar
  8. 8.
    Ghifary M, Kleijn WB, Zhang M (2014) Domain adaptive neural networks for object recognition. In: Pacific rim international conference on artificial intelligence, Springer, pp 898–904Google Scholar
  9. 9.
    Glorot X, Bordes A, Bengio Y (2011) Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th international conference on machine learning (ICML-11), pp 513–520Google Scholar
  10. 10.
    Hai Z, Chang K, Kim Jj (2011) Implicit feature identification via co-occurrence association rule mining. In: Computational linguistics and intelligent text processing, pp 393–404Google Scholar
  11. 11.
    Hong C, Chen X, Wang X, Tang C (2016) Hypergraph regularized autoencoder for image-based 3d human pose recovery. Signal Process 124:132–140CrossRefGoogle Scholar
  12. 12.
    Hong C, Yu J, Wan J, Tao D, Wang M (2015) Multimodal deep autoencoder for human pose recovery. IEEE Trans Image Process 24(12):5659–5670MathSciNetCrossRefGoogle Scholar
  13. 13.
    Huang S, Liu X, Peng X, Niu Z (2012) Fine-grained product features extraction and categorization in reviews opinion mining. In: 2012 IEEE 12th international conference on data mining workshops (ICDMW). IEEE, pp 680–686Google Scholar
  14. 14.
    Jagarlamudi J, Daumé III H, Udupa R (2012) Incorporating lexical priors into topic models. In: Proceedings of the 13th conference of the European chapter of the association for computational linguistics. Association for Computational Linguistics, pp 204–213Google Scholar
  15. 15.
    Jakob N, Gurevych I (2010) Extracting opinion targets in a single-and cross-domain setting with conditional random fields. In: Proceedings of the 2010 conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 1035–1045Google Scholar
  16. 16.
    Jamal A, Goode M (2001) Consumers’ product evaluation: a study of the primary evaluative criteria in the precious jewellery market in the UK. J Consum Behav 1(2):140–155CrossRefGoogle Scholar
  17. 17.
    Jin W, Ho HH, Srihari RK (2009) A novel lexicalized hmm-based learning framework for web opinion mining. In: Proceedings of the 26th annual international conference on machine learning, pp. 465–472Google Scholar
  18. 18.
    Jo Y, Oh AH (2011) Aspect and sentiment unification model for online review analysis. In: Proceedings of the fourth ACM international conference on Web search and data mining. ACM, pp 815–824Google Scholar
  19. 19.
    Kim S, Zhang J, Chen Z, Oh AH, Liu S (2013) A hierarchical aspect-sentiment model for online reviews. In: AAAIGoogle Scholar
  20. 20.
    Kim Y (2014) Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882
  21. 21.
    Li F, Han C, Huang M, Zhu X, Xia YJ, Zhang S, Yu H (2010) Structure-aware review mining and summarization. In: Proceedings of the 23rd international conference on computational linguistics. Association for Computational Linguistics, pp 653–661Google Scholar
  22. 22.
    Lin C, He Y (2009) Joint sentiment/topic model for sentiment analysis. In: Proceedings of the 18th ACM conference on Information and knowledge management. ACM, pp 375–384Google Scholar
  23. 23.
    Liu Q, Liu B, Zhang Y, Kim DS, Gao Z (2016) Improving opinion aspect extraction using semantic similarity and aspect associations. In: AAAI, pp 2986–2992Google Scholar
  24. 24.
    Liu B, Zhiyuan C, Arjun M (2014) Aspect extraction with automated prior knowledge learning. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics, pp 347–358Google Scholar
  25. 25.
    McAuley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on Recommender systems. ACM, pp 165–172Google Scholar
  26. 26.
    McLachlan G, Do KA, Ambroise C (2005) Analyzing microarray gene expression data, vol 422. Wiley, New YorkzbMATHGoogle Scholar
  27. 27.
    Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
  28. 28.
    Mitchell M, Aguilar J, Wilson T, Van Durme B (2013) Open domain targeted sentimentGoogle Scholar
  29. 29.
    Moghaddam S, Ester M (2011) Ilda: interdependent lda model for learning latent aspects and their ratings from online product reviews. In: Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval. ACM, pp 665–674Google Scholar
  30. 30.
    Mukherjee A, Liu B (2012) Aspect extraction through semi-supervised modeling. In: Proceedings of the 50th annual meeting of the association for computational linguistics: long papers, vol 1. Association for Computational Linguistics, pp 339–348Google Scholar
  31. 31.
    Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRefGoogle Scholar
  32. 32.
    Poria S, Cambria E, Gelbukh A (2016) Aspect extraction for opinion mining with a deep convolutional neural network. Knowl Based Syst 108:42–49CrossRefGoogle Scholar
  33. 33.
    Poria S, Cambria E, Gelbukh A, Bisio F, Hussain A (2015) Sentiment data flow analysis by means of dynamic linguistic patterns. IEEE Comput Intell Mag 10(4):26–36CrossRefGoogle Scholar
  34. 34.
    Poria S, Cambria E, Ku L W , Gui C, Gelbukh A (2014) A rule-based approach to aspect extraction from product reviews. In: Proceedings of the second workshop on natural language processing for social media (SocialNLP), pp 28–37Google Scholar
  35. 35.
    Poria S, Chaturvedi I, Cambria E, Bisio F (2016) Sentic lda: improving on lda with semantic similarity for aspect-based sentiment analysis. In: 2016 international joint conference on neural networks (IJCNN). IEEE, pp 4465–4473Google Scholar
  36. 36.
    Qian S, Liu H, Liu C, Wu S, San Wong H (2018) Adaptive activation functions in convolutional neural networks. Neurocomputing 272:204–212CrossRefGoogle Scholar
  37. 37.
    Qiu G, Liu B, Bu J, Chen C (2011) Opinion word expansion and target extraction through double propagation. Comput Linguist 37(1):9–27CrossRefGoogle Scholar
  38. 38.
    Samiee S (1994) Customer evaluation of products in a global market. J Int Bus Stud 25(3):579–604CrossRefGoogle Scholar
  39. 39.
    Semeval-2014 dataset (2014) In: International workshop on semantic evaluation. https://alt.qcri.org/semeval2014
  40. 40.
    Sharif Razavian A, Azizpour H, Sullivan J, Carlsson S (2014) Cnn features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 806–813Google Scholar
  41. 41.
    Silva J, Coheur L, Mendes AC, Wichert A (2011) From symbolic to sub-symbolic information in question classification. Artif Intell Rev 35(2):137–154CrossRefGoogle Scholar
  42. 42.
    Socher R, Ganjoo M, Manning CD, Ng A (2013) Zero-shot learning through cross-modal transfer. In: Advances in neural information processing systems, pp 935–943Google Scholar
  43. 43.
    Socher R, Pennington J, Huang EH, Ng AY, Manning CD (2011) Semi-supervised recursive autoencoders for predicting sentiment distributions. In: Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 151–161Google Scholar
  44. 44.
    Toh Z, Wang W (2014) Dlirec: Aspect term extraction and term polarity classification system. In: Proceedings of the 8th international workshop on semantic evaluation (SemEval 2014), pp 235–240Google Scholar
  45. 45.
    van Ginneken B, Setio AA, Jacobs C, Ciompi F (2015) Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans. In: 2015 IEEE 12th international symposium on biomedical imaging (ISBI). IEEE, pp 286–289Google Scholar
  46. 46.
    Veryzer RW (1998) Key factors affecting customer evaluation of discontinuous new products. J Prod Innov Manag 15(2):136–150CrossRefGoogle Scholar
  47. 47.
    Wang H (2015) Sentiment-aligned topic models for product aspect rating prediction. Ph.D. thesis, Applied Sciences, School of Computing ScienceGoogle Scholar
  48. 48.
    Wang S, Manning CD (2012) Baselines and bigrams: Simple, good sentiment and topic classification. In: Proceedings of the 50th annual meeting of the association for computational linguistics: short papers, vol 2. Association for Computational Linguistics, pp 90–94Google Scholar
  49. 49.
    Wang T, Cai Y, Leung Hf, Lau RY, Li Q, Min H (2014) Product aspect extraction supervised with online domain knowledge. Knowl Based Syst 71:86–100CrossRefGoogle Scholar
  50. 50.
    Wu Y, Zhang Q, Huang X, Wu L (2009) Phrase dependency parsing for opinion mining. In: Proceedings of the 2009 conference on empirical methods in natural language processing, vol 3. Association for Computational Linguistics, pp 1533–1541Google Scholar
  51. 51.
    Yang B, Cardie C (2013) Joint inference for fine-grained opinion extraction. In: ACL, vol 1, pp 1640–1649Google Scholar
  52. 52.
    Yang B, Cardie C (2014) Context-aware learning for sentence-level sentiment analysis with posterior regularization. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (volume 1: long papers), vol 1, pp 325–335Google Scholar
  53. 53.
    Yang M, Liu Y, You Z (2017) The euclidean embedding learning based on convolutional neural network for stereo matching. Neurocomputing 267:195–200CrossRefGoogle Scholar
  54. 54.
    Zhang L, Liu B, Lim S H , O’Brien-Strain E (2010) Extracting and ranking product features in opinion documents. In: Proceedings of the 23rd international conference on computational linguistics: posters. Association for Computational Linguistics, pp 1462–1470Google Scholar
  55. 55.
    Zhao WX, Jiang J, Yan H, Li X (2010) Jointly modeling aspects and opinions with a maxent-lda hybrid. In: Proceedings of the 2010 conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 56–65Google Scholar
  56. 56.
    Zhou X, Wan X, Xiao J (2013) Collective opinion target extraction in chinese microblogs. In: EMNLP, vol 13, pp 1840–1850Google Scholar
  57. 57.
    Zhu J, Wang H, Tsou B K, Zhu M. (2009). Multi-aspect opinion polling from textual reviews. In: Proceedings of the 18th ACM conference on information and knowledge management. ACM, pp 1799–1802Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Industrial EngineeringSeoul National UniversitySeoulRepublic of Korea
  2. 2.Data Driven User Experience team, Mobile Communication LabLG ElectronicsSeoulRepublic of Korea

Personalised recommendations