Advertisement

An Exploratory Study on Design and Implement an Emotional Karaoke Robot (EKR)

  • Yi-Lun Zheng
  • Pei-Luen Patrick Rau
  • Hsiu-Ping Yueh
  • Pin-Hsuan Chen
  • Ding-Long Huang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10911)

Abstract

The objective of this study is to design and evaluate an Emotional Karaoke Robot system (EKR) which improves user experience. An exploratory study was conducted to discover the changes of participants’ emotion toward the EKR system during the experiment. 16 Chinese participants who had been to karaoke TV in the past 6 months were invited to use the EKR system. Four interactive conditions (simple interaction task, diverse neutral emotional interaction task, diverse positive emotional interaction task, diverse negative emotional interaction task) with a within-subject design were conducted. The results indicated that participants’ emotional reaction were enhanced a lot during the study. The average level of arousal, hedonic value, and user satisfaction under diverse positive/negative emotional interaction condition is greater than under the neutral one. Participants in diverse positive/negative emotional interaction task felt more positive than in diverse neutral emotional interaction task. Emotional Karaoke Robot system successfully elicited participants’ emotion and improved users’ experience.

Keywords

Human-robot interaction Interaction design Emotional robot Social robot Karaoke TV 

Notes

Acknowledgement

This research was supported by Shenzhen Malong Artificial Intelligence Research Center.

References

  1. Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum Comput Stud. 59(1), 119–155 (2003).  https://doi.org/10.1016/S1071-5819(03)00018-1CrossRefGoogle Scholar
  2. Breazeal, C.L.: Designing Sociable Robots. The MIT Press, Cambridge (2004)zbMATHGoogle Scholar
  3. Broadbent, E., Peri, K., Kerse, N., Jayawardena, C., Kuo, I., Datta, C., MacDonald, B.: Robots in older people’s homes to improve medication adherence and quality of life: a randomised cross-over trial. In: Beetz, M., Johnston, B. (eds.) ICSR 2014. LNCS (LNAI), vol. 8755, pp. 64–73. Springer, Cham (2014).  https://doi.org/10.1007/978-3-319-11973-1_7CrossRefGoogle Scholar
  4. Choi, J.J., Kim, Y., Kwak, S.S.: Are you embarrassed? The impact of robot types on emotional engagement with a robot. In: 2014 ACM/IEEE International Conference on Human-robot Interaction, pp. 138–139. ACM, Bielefeld (2014).  https://doi.org/10.1145/2559636.2559798
  5. Cook, J.R.: Cognitive and social factors in the design of computerized jobs. Doctoral Dissertation, Purdue University, West Lafayette, Indiana (1991)Google Scholar
  6. De Graaf, M.M., Allouch, S.B.: Exploring influencing variables for the acceptance of social robots. Robot. Auton. Syst. 61(12), 1476–1486 (2013).  https://doi.org/10.1016/j.robot.2013.07.007CrossRefGoogle Scholar
  7. Devillers, L., Tahon, M., Sehili, M.A., Delaborde, A.: Inference of human beings’ emotional states from speech in human–robot interactions. Int. J. Soc. Robot. 7(4), 451–463 (2015).  https://doi.org/10.1007/s12369-015-0297-8CrossRefGoogle Scholar
  8. Ekman, P.: An argument for basic emotions. Cogn. Emot. 6(3–4), 169–200 (1992).  https://doi.org/10.1080/02699939208411068CrossRefGoogle Scholar
  9. Ferrarelli, P., Lázaro, María T., Iocchi, L.: Design of robot teaching assistants through multi-modal human-robot interactions. In: Lepuschitz, W., Merdan, M., Koppensteiner, G., Balogh, R. (eds.) RiE 2017. AISC, vol. 630, pp. 274–286. Springer, Cham (2018).  https://doi.org/10.1007/978-3-319-62875-2_25CrossRefGoogle Scholar
  10. Fong, T., Nourbakhsh, I., Dautenhahn, K.: A survey of socially interactive robots. Robot. Auton. Syst. 42(3–4), 143–166 (2003).  https://doi.org/10.1016/S0921-8890(02)00372-XCrossRefzbMATHGoogle Scholar
  11. Gehle, R., Pitsch, K., Dankert, T., Wrede, S.: How to open an interaction between robot and museum visitor? Strategies to establish a focused encounter in HRI. In: 2017 ACM/IEEE International Conference on Human-Robot Interaction, pp. 187–195. ACM, Vienna (2017).  https://doi.org/10.1145/2909824.3020219
  12. Goetz, J., Kiesler, S., Powers, A.: Matching robot appearance and behavior to tasks to improve human–robot cooperation. In: 12th IEEE International Workshop on Robot and Human Interactive Communication (Roman 2003), pp. 55–60. IEEE, Millbrae (2003).  https://doi.org/10.1109/roman.2003.1251796
  13. Jokinen, J.P.: Emotional user experience: traits, events, and states. Int. J. Hum Comput Stud. 76, 67–77 (2015).  https://doi.org/10.1016/j.ijhcs.2014.12.006CrossRefGoogle Scholar
  14. Kanda, T., Ishiguro, H., Ono, T., Imai, M., Nakatsu, R.: Development and evaluation of an interactive humanoid robot “Robovie”. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA 2002), pp. 1848–1855. IEEE, Washington (2002).  https://doi.org/10.1109/robot.2002.1014810
  15. Kanda, T., Shiomi, M., Miyashita, Z., Ishiguro, H., Hagita, N.: An affective guide robot in a shopping mall. In: 4th ACM/IEEE International Conference on Human Robot Interaction, pp. 173–180. ACM, New York (2009).  https://doi.org/10.1145/1514095.1514127
  16. Kaplan, F.: Who is afraid of the humanoid? Investigating cultural differences in the acceptance of robots. Int. J. Humanoid Rob. 1(03), 465–480 (2004).  https://doi.org/10.1142/S0219843604000289MathSciNetCrossRefGoogle Scholar
  17. Kim, E.H., Kwak, S.S., Kwak, Y.K.: Can robotic emotional expressions induce a human to empathize with a robot? In: 18th IEEE International Symposium on Robot and Human Interactive Communication (ROMAN), pp. 358–362. IEEE, Toyama (2009).  https://doi.org/10.1109/roman.2009.5326282
  18. Kim, E.H., Kwak, S.S., Hyun, K.H., Kim, S.H., Kwak, Y.K.: Design and development of an emotional interaction robot, mung. Adv. Robot. 23(6), 767–784 (2009).  https://doi.org/10.1163/156855309X431712CrossRefGoogle Scholar
  19. Kirby, R., Forlizzi, J., Simmons, R.: Affective social robots. Robot. Auton. Syst. 58(3), 322–332 (2010).  https://doi.org/10.1016/j.robot.2009.09.015CrossRefGoogle Scholar
  20. Kishi, T., Otani, T., Endo, N., Kryczka, P., Hashimoto, K., Nakata, K., Takanishi, A.: Development of expressive robotic head for bipedal humanoid robot. In: Intelligent Robots and Systems (IROS), pp. 4584–4589. IEEE, Portugal (2012).  https://doi.org/10.1109/iros.2012.6386050
  21. Kwak, S.S., Kim, Y., Kim, E., Shin, C., Cho, K.: What makes people empathize with an emotional robot? The impact of agency and physical embodiment on human empathy for a robot. In: 22nd IEEE International Symposium on Robot and Human Interactive Communication, pp. 180–185. IEEE, Gyeongju (2013).  https://doi.org/10.1109/roman.2013.6628441
  22. Lazarus, R.S.: Thoughts on the relations between emotion and cognition. Am. Psychol. 37(9), 1019–1024 (1982).  https://doi.org/10.1037/0003-066X.37.9.1019CrossRefGoogle Scholar
  23. Mehrabian, A., Russell, J.A.: An Approach to Environmental Psychology. The MIT Press, Cambridge (1974)Google Scholar
  24. Mori, M.: The uncanny valley. Energy 7(4), 33–35 (1970)Google Scholar
  25. Oztop, E., Franklin, D.W., Chaminade, T., Cheng, G.: Human–humanoid interaction: is a humanoid robot perceived as a human? Int. J. Humanoid Rob. 2(04), 537–559 (2005).  https://doi.org/10.1142/S0219843605000582CrossRefGoogle Scholar
  26. Rau, P.P., Li, Y., Li, D.: Effects of communication style and culture on ability to accept recommendations from robots. Comput. Hum. Behav. 25(2), 587–595 (2009).  https://doi.org/10.1016/j.chb.2008.12.025CrossRefGoogle Scholar
  27. Riek, L.D., Rabinowitch, T.C., Bremner, P., Pipe, A.G., Fraser, M., Robinson, P.: Cooperative gestures: effective signaling for humanoid robots. In: 5th ACM/IEEE International Conference on Human-robot Interaction, pp. 61–68. IEEE, Osaka (2010).  https://doi.org/10.1109/hri.2010.5453266
  28. Rudovic, O., Lee, J., Mascarell-Maricic, L., Schuller, B.W., Picard, R.W.: Measuring engagement in robot-assisted autism therapy: a cross-cultural study. Front. Robot. AI 4, 36 (2017).  https://doi.org/10.3389/frobt.2017.00036CrossRefGoogle Scholar
  29. Ruismäki, H., Antti, J., Lehtonen, K.: Karaoke – the chance to be a star. Eur. J. Soc. Behav. Sci. 7(4), 1222–1233 (2013).  https://doi.org/10.15405/ejsbs.102CrossRefGoogle Scholar
  30. Sidner, C.L., Lee, C., Kidd, C.D., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artif. Intell. 166(1–2), 140–164 (2005).  https://doi.org/10.1016/j.artint.2005.03.005CrossRefGoogle Scholar
  31. Wei, Y., Wei, Y., Zhao, J., Zhao, J.: Designing robot behavior in human robot interaction based on emotion expression. Ind. Robot Int. J. 43(4), 380–389 (2016).  https://doi.org/10.1108/IR-08-2015-0164CrossRefGoogle Scholar
  32. Wu, S.H., Huang, C.T., Chen, Y.F.: Leisure-service quality and hedonic experiences: Singing at a karaoke house as a form of theatre. Total Qual. Manag. Bus. Excell. 26(3–4), 298–311 (2015).  https://doi.org/10.1080/14783363.2013.814290CrossRefGoogle Scholar
  33. Zhao, S.: Humanoid social robots as a medium of communication. New Media Soc. 8(3), 401–419 (2006).  https://doi.org/10.1177/1461444806061951CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Industrial EngineeringTsinghua UniversityBeijingChina
  2. 2.Department of Bio-Industry Communication and DevelopmentNational Taiwan UniversityTaipeiTaiwan
  3. 3.Shenzhen Malong Artificial Intelligence Research CenterShenzhenChina

Personalised recommendations