Multimedia Tools and Applications

, Volume 78, Issue 3, pp 3009–3043 | Cite as

IoT-based personalized NIE content recommendation system

  • Yongsung Kim
  • Seungwon Jung
  • Seonmi Ji
  • Eenjun HwangEmail author
  • Seungmin Rho


Recently, the Internet of Things (IoT) has become a popular topic and a dominant trend in various fields, such as healthcare, agriculture, manufacturing, and transportation. In particular, in the field of education, it has become a popular tool to improve learners’ interests and achievements by making them interact with various devices in and out of the classroom. Lessons in newspaper in education (NIE), which uses newspapers as an educational resource, have started to utilize it. For instance, by analyzing the data generated from a learner’s device, such as Raspberry Pi, appropriate news and related multimedia data can be provided to the learners as learning materials to support the lesson. However, as news and multimedia data are scattered in a wide variety of forms, it is very difficult to select appropriate ones for the learner. In this paper, we propose a news and related multimedia recommendation scheme based on IoT for supporting NIE lessons. Specifically, news and related multimedia data are collected from the Web, and they are integrated and stored into the server. After that, the learner can easily browse such contents using a mobile device through personalized visualization, which increase the efficiency of NIE lessons. To show the effectiveness of our scheme, we implemented a prototype system and performed various experiments. We present some of the results.


Internet of things News in education Multimedia in education Semantic web Deep learning Data integration 



This work was partly supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No. R0190-16-2012, High Performance Big Data Analytics Platform Performance Acceleration Technologies Development) and Basic Science Research Program through the National Research Foundation of Korea(NRF) funded by the Ministry of Education(NRF-2016R1D1A1A09919590).


  1. 1.
    Ashton K (2011) That ‘internet of things’ thing. RFiD Journal 22(7)Google Scholar
  2. 2.
    Atzori L, Iera A, Morabito G (2010) The internet of things: a survey. Comput Netw 54(15):2787–2805zbMATHCrossRefGoogle Scholar
  3. 3.
    Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:14090473Google Scholar
  4. 4.
    Brown PF, Desouza PV, Mercer RL, Pietra VJD, Lai JC (1992) Class-based n-gram models of natural language. Comput Linguist 18(4):467–479Google Scholar
  5. 5.
    Chorowski JK, Bahdanau D, Serdyuk D, Cho K, Bengio Y (2015) Attention-based models for speech recognition. In: Advances in Neural Information Processing Systems, pp 577–585Google Scholar
  6. 6.
    Daga E, d’Aquin M, Adamou A, Brown S (2016) The open university linked data–data. Semantic Web 7(2):183–191CrossRefGoogle Scholar
  7. 7.
    Daniel A, Paul A, Ahmad A, Rho S (2016) Cooperative intelligence of vehicles for intelligent transportation systems (ITS). Wirel Pers Commun 87(2):461–484CrossRefGoogle Scholar
  8. 8.
    Deng L, Yu D (2014) Deep learning: methods and applications. Foundations and Trends® in Signal Processing 7(3–4):197–387MathSciNetzbMATHCrossRefGoogle Scholar
  9. 9.
    Deng L, Li J, Huang J-T, Yao K, Yu D, Seide F, Seltzer M, Zweig G, He X, Williams J (2013) Recent advances in deep learning for speech research at microsoft. In: Acoustics, Speech and Signal Processing (ICASSP), 2013 I.E. International Conference on. IEEE, pp 8604–8608Google Scholar
  10. 10.
    Dietze S, Yu HQ, Giordano D, Kaldoudi E, Dovrolis N, Taibi D (2012) Linked Education: interlinking educational resources and the web of data. In: Proceedings of the 27th annual ACM symposium on applied computing. ACM, pp 366–371Google Scholar
  11. 11.
    Dietze S, Sanchez-Alonso S, Ebner H, Qing Yu H, Giordano D, Marenzi I, Pereira Nunes B (2013) Interlinking educational resources and the web of data: a survey of challenges and approaches. Program 47(1):60–91CrossRefGoogle Scholar
  12. 12.
    Elmisery AM, Rho S, Botvich D (2016) A fog based middleware for automated compliance with OECD privacy principles in internet of healthcare things. IEEE Access 4:8418–8441CrossRefGoogle Scholar
  13. 13.
    Elmisery AM, Rho S, Aborizka M (2017) A new computing environment for collective privacy protection from constrained healthcare devices to IoT cloud services. Cluster Computing :1–28Google Scholar
  14. 14.
    Freda MC (2005) The readability of american academy of pediatrics patient education brochures. J Pediatr Health Care 19(3):151–156CrossRefGoogle Scholar
  15. 15.
    Gómez J, Huete JF, Hoyos O, Perez L, Grigori D (2013) Interaction system based on internet of things as support for education. Procedia Comput Sci 21:132–139CrossRefGoogle Scholar
  16. 16.
    Gubbi J, Buyya R, Marusic S, Palaniswami M (2013) Internet of things (IoT): a vision, architectural elements, and future directions. Futur Gener Comput Syst 29(7):1645–1660CrossRefGoogle Scholar
  17. 17.
    He J, Lo DC-T, Xie Y, Lartigue J (2016) Integrating internet of things (IoT) into STEM undergraduate education: case study of a modern technology infused courseware for embedded system course. In: Frontiers in Education Conference (FIE), 2016 IEEE. IEEE, pp 1–9Google Scholar
  18. 18.
    Kim Y (2014) Convolutional neural networks for sentence classification. arXiv preprint arXiv:14085882Google Scholar
  19. 19.
    Kim Y, Na B, Park J, Rho S, Hwang E (2016) Twitter news in education platform for collaborative learning. In: Platform Technology and Service (PlatCon), 2016 International Conference on. IEEE, pp 1–4Google Scholar
  20. 20.
    Kim Y, Hwang E, Rho S (2016) Twitter news-in-education platform for social, collaborative, and flipped learning. J Supercomput :1–19Google Scholar
  21. 21.
    Kortuem G, Bandara AK, Smith N, Richards M, Petre M (2013) Educating the internet-of-things generation. Computer 46(2):53–61CrossRefGoogle Scholar
  22. 22.
    Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105Google Scholar
  23. 23.
    Li S, Da Xu L, Zhao S (2015) The internet of things: a survey. Inf Syst Front 17(2):243–259CrossRefGoogle Scholar
  24. 24.
    Luong M-T, Pham H, Manning CD (2015) Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:150804025Google Scholar
  25. 25.
    Ma J, Gao W, Mitra P, Kwon S, Jansen BJ, Wong K-F, Cha M (2016) Detecting rumors from microblogs with recurrent neural networks. In: IJCAI, pp 3818–3824Google Scholar
  26. 26.
    Mihalcea R, Tarau P (2004) TextRank: bringing order into text. In: EMNLP, pp 404–411Google Scholar
  27. 27.
    Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp 3111–3119Google Scholar
  28. 28.
    Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:13013781Google Scholar
  29. 29.
    Nentwig M, Hartung M, Ngonga Ngomo A-C, Rahm E (2017) A survey of current link discovery frameworks. Semantic Web 8(3):419–436CrossRefGoogle Scholar
  30. 30.
    Ngomo A-CN, Auer S (2011) Limes-a time-efficient approach for large-scale link discovery on the web of data. In: IJCAI, pp 2312–2317Google Scholar
  31. 31.
    Oliveras B, Márquez C, Sanmartí N (2013) The use of newspaper articles as a tool to develop critical thinking in science classes. Int J Sci Educ 35(6):885–905CrossRefGoogle Scholar
  32. 32.
    Rajabi E, Sicilia M-A, Sanchez-Alonso S (2013) Interlinking educational data: an experiment with GLOBE resources. In: Proceedings of the First International Conference on Technological Ecosystem for Enhancing Multiculturality. ACM, pp 339–348Google Scholar
  33. 33.
    Rajabi E, Sicilia M-A, Sanchez-Alonso S (2014) An empirical study on the evaluation of interlinking tools on the web of data. J Inf Sci 40(5):637–648CrossRefGoogle Scholar
  34. 34.
    Rathore MM, Ahmad A, Paul A, Rho S (2016) Urban planning and building smart cities based on the internet of things using big data analytics. Comput Netw 101:63–80CrossRefGoogle Scholar
  35. 35.
    Raths D (2014) Nine video tips for a better flipped classroom. Educ Dig 79(6):15Google Scholar
  36. 36.
    Roach T (2014) Student perceptions toward flipped learning: new methods to increase interaction and active learning in economics. Int Rev Econ Educ 17:74–84CrossRefGoogle Scholar
  37. 37.
    Salton G, Buckley C (1988) Term-weighting approaches in automatic text retrieval. Inf Process Manag 24(5):513–523CrossRefGoogle Scholar
  38. 38.
    Severyn A, Moschitti A (2015) Twitter sentiment analysis with deep convolutional neural networks. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, pp 959–962Google Scholar
  39. 39.
    Sherer P, Shea T (2011) Using online video to support student learning and engagement. Coll Teach 59(2):56–59CrossRefGoogle Scholar
  40. 40.
    Singh D, Tripathi G, Jara AJ (2014) A survey of internet-of-things: future vision, architecture, challenges and services. In: Internet of things (WF-IoT), 2014 I.E. World Forum on. IEEE, pp 287–292Google Scholar
  41. 41.
    Sun X, Li C, Ren F (2016) Sentiment analysis for Chinese microblog based on deep neural networks with convolutional extension features. Neurocomputing 210:227–236CrossRefGoogle Scholar
  42. 42.
    Volz J, Bizer C, Gaedke M, Kobilarov G (2009) Silk-a link discovery framework for the web of data. LDOW 538Google Scholar
  43. 43.
    Wang Y (2010) English interactive teaching model which based upon internet of things. In: Computer Application and System Modeling (ICCASM), 2010 International Conference on. IEEE, pp V13-587-V513–590Google Scholar
  44. 44.
    Whitmore A, Agarwal A, Da Xu L (2015) The internet of things—a survey of topics and trends. Inf Syst Front 17(2):261–274CrossRefGoogle Scholar
  45. 45.
    Xu L, Jiang C, Ren Y, Chen H-H (2016) Microblog dimensionality reduction—a deep learning approach. IEEE Trans Knowl Data Eng 28(7):1779–1789CrossRefGoogle Scholar
  46. 46.
    Yu HQ, Pedrinaci C, Dietze S, Domingue J (2012) Using linked data to annotate and search educational video resources for supporting distance learning. IEEE Trans Learn Technol 5(2):130–142CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Yongsung Kim
    • 1
  • Seungwon Jung
    • 1
  • Seonmi Ji
    • 1
  • Eenjun Hwang
    • 1
    Email author
  • Seungmin Rho
    • 2
  1. 1.School of Electrical EngineeringKorea UniversitySeoulSouth Korea
  2. 2.Department of Media SoftwareSungkyul UniversityAnyangSouth Korea

Personalised recommendations