An Exploratory Study on Design and Implement an Emotional Karaoke Robot (EKR)

  • Yi-Lun ZhengEmail author
  • Pei-Luen Patrick RauEmail author
  • Hsiu-Ping YuehEmail author
  • Pin-Hsuan ChenEmail author
  • Ding-Long Huang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10911)


The objective of this study is to design and evaluate an Emotional Karaoke Robot system (EKR) which improves user experience. An exploratory study was conducted to discover the changes of participants’ emotion toward the EKR system during the experiment. 16 Chinese participants who had been to karaoke TV in the past 6 months were invited to use the EKR system. Four interactive conditions (simple interaction task, diverse neutral emotional interaction task, diverse positive emotional interaction task, diverse negative emotional interaction task) with a within-subject design were conducted. The results indicated that participants’ emotional reaction were enhanced a lot during the study. The average level of arousal, hedonic value, and user satisfaction under diverse positive/negative emotional interaction condition is greater than under the neutral one. Participants in diverse positive/negative emotional interaction task felt more positive than in diverse neutral emotional interaction task. Emotional Karaoke Robot system successfully elicited participants’ emotion and improved users’ experience.


Human-robot interaction Interaction design Emotional robot Social robot Karaoke TV 



This research was supported by Shenzhen Malong Artificial Intelligence Research Center.


  1. Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum Comput Stud. 59(1), 119–155 (2003). Scholar
  2. Breazeal, C.L.: Designing Sociable Robots. The MIT Press, Cambridge (2004)zbMATHGoogle Scholar
  3. Broadbent, E., Peri, K., Kerse, N., Jayawardena, C., Kuo, I., Datta, C., MacDonald, B.: Robots in older people’s homes to improve medication adherence and quality of life: a randomised cross-over trial. In: Beetz, M., Johnston, B. (eds.) ICSR 2014. LNCS (LNAI), vol. 8755, pp. 64–73. Springer, Cham (2014). Scholar
  4. Choi, J.J., Kim, Y., Kwak, S.S.: Are you embarrassed? The impact of robot types on emotional engagement with a robot. In: 2014 ACM/IEEE International Conference on Human-robot Interaction, pp. 138–139. ACM, Bielefeld (2014).
  5. Cook, J.R.: Cognitive and social factors in the design of computerized jobs. Doctoral Dissertation, Purdue University, West Lafayette, Indiana (1991)Google Scholar
  6. De Graaf, M.M., Allouch, S.B.: Exploring influencing variables for the acceptance of social robots. Robot. Auton. Syst. 61(12), 1476–1486 (2013). Scholar
  7. Devillers, L., Tahon, M., Sehili, M.A., Delaborde, A.: Inference of human beings’ emotional states from speech in human–robot interactions. Int. J. Soc. Robot. 7(4), 451–463 (2015). Scholar
  8. Ekman, P.: An argument for basic emotions. Cogn. Emot. 6(3–4), 169–200 (1992). Scholar
  9. Ferrarelli, P., Lázaro, María T., Iocchi, L.: Design of robot teaching assistants through multi-modal human-robot interactions. In: Lepuschitz, W., Merdan, M., Koppensteiner, G., Balogh, R. (eds.) RiE 2017. AISC, vol. 630, pp. 274–286. Springer, Cham (2018). Scholar
  10. Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robot. Auton. Syst. 42(3–4), 143–166 (2003). Scholar
  11. Gehle, R., Pitsch, K., Dankert, T., Wrede, S.: How to open an interaction between robot and museum visitor? Strategies to establish a focused encounter in HRI. In: 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 187–195. ACM, Vienna (2017).
  12. Goetz, J., Kiesler, S., Powers, A.: Matching robot appearance and behavior to tasks to improve human–robot cooperation. In: 12th IEEE International Workshop on Robot and Human Interactive Communication (Roman 2003), pp. 55–60. IEEE, Millbrae (2003).
  13. Jokinen, J.P.: Emotional user experience: traits, events, and states. Int. J. Hum Comput Stud. 76, 67–77 (2015). Scholar
  14. Kanda, T., Ishiguro, H., Ono, T., Imai, M., Nakatsu, R.: Development and evaluation of an interactive humanoid robot “Robovie”. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA 2002), pp. 1848–1855. IEEE, Washington (2002).
  15. Kanda, T., Shiomi, M., Miyashita, Z., Ishiguro, H., Hagita, N.: An affective guide robot in a shopping mall. In: 4th ACM/IEEE International Conference on Human Robot Interaction, pp. 173–180. ACM, New York (2009).
  16. Kaplan, F.: Who is afraid of the humanoid? Investigating cultural differences in the acceptance of robots. Int. J. Humanoid Rob. 1(03), 465–480 (2004). Scholar
  17. Kim, E.H., Kwak, S.S., Kwak, Y.K.: Can robotic emotional expressions induce a human to empathize with a robot? In: 18th IEEE International Symposium on Robot and Human Interactive Communication (ROMAN), pp. 358–362. IEEE, Toyama (2009).
  18. Kim, E.H., Kwak, S.S., Hyun, K.H., Kim, S.H., Kwak, Y.K.: Design and development of an emotional interaction robot, mung. Adv. Robot. 23(6), 767–784 (2009). Scholar
  19. Kirby, R., Forlizzi, J., Simmons, R.: Affective social robots. Robot. Auton. Syst. 58(3), 322–332 (2010). Scholar
  20. Kishi, T., Otani, T., Endo, N., Kryczka, P., Hashimoto, K., Nakata, K., Takanishi, A.: Development of expressive robotic head for bipedal humanoid robot. In: Intelligent Robots and Systems (IROS), pp. 4584–4589. IEEE, Portugal (2012).
  21. Kwak, S.S., Kim, Y., Kim, E., Shin, C., Cho, K.: What makes people empathize with an emotional robot? The impact of agency and physical embodiment on human empathy for a robot. In: 22nd IEEE International Symposium on Robot and Human Interactive Communication, pp. 180–185. IEEE, Gyeongju (2013).
  22. Lazarus, R.S.: Thoughts on the relations between emotion and cognition. Am. Psychol. 37(9), 1019–1024 (1982). Scholar
  23. Mehrabian, A., Russell, J.A.: An Approach to Environmental Psychology. The MIT Press, Cambridge (1974)Google Scholar
  24. Mori, M.: The uncanny valley. Energy 7(4), 33–35 (1970)Google Scholar
  25. Oztop, E., Franklin, D.W., Chaminade, T., Cheng, G.: Human–humanoid interaction: is a humanoid robot perceived as a human? Int. J. Humanoid Rob. 2(04), 537–559 (2005). Scholar
  26. Rau, P.P., Li, Y., Li, D.: Effects of communication style and culture on ability to accept recommendations from robots. Comput. Hum. Behav. 25(2), 587–595 (2009). Scholar
  27. Riek, L.D., Rabinowitch, T.C., Bremner, P., Pipe, A.G., Fraser, M., Robinson, P.: Cooperative gestures: effective signaling for humanoid robots. In: 5th ACM/IEEE International Conference on Human-robot Interaction, pp. 61–68. IEEE, Osaka (2010).
  28. Rudovic, O., Lee, J., Mascarell-Maricic, L., Schuller, B.W., Picard, R.W.: Measuring engagement in robot-assisted autism therapy: a cross-cultural study. Front. Robot. AI 4, 36 (2017). Scholar
  29. Ruismäki, H., Antti, J., Lehtonen, K.: Karaoke – the chance to be a star. Eur. J. Soc. Behav. Sci. 7(4), 1222–1233 (2013). Scholar
  30. Sidner, C.L., Lee, C., Kidd, C.D., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artif. Intell. 166(1–2), 140–164 (2005). Scholar
  31. Wei, Y., Wei, Y., Zhao, J., Zhao, J.: Designing robot behavior in human robot interaction based on emotion expression. Ind. Robot Int. J. 43(4), 380–389 (2016). Scholar
  32. Wu, S.H., Huang, C.T., Chen, Y.F.: Leisure-service quality and hedonic experiences: Singing at a karaoke house as a form of theatre. Total Qual. Manag. Bus. Excell. 26(3–4), 298–311 (2015). Scholar
  33. Zhao, S.: Humanoid social robots as a medium of communication. New Media Soc. 8(3), 401–419 (2006). Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Industrial EngineeringTsinghua UniversityBeijingChina
  2. 2.Department of Bio-Industry Communication and DevelopmentNational Taiwan UniversityTaipeiTaiwan
  3. 3.Shenzhen Malong Artificial Intelligence Research CenterShenzhenChina

Personalised recommendations