Adaptive Augmented Reality User Interfaces Using Face Recognition for Smart Home Control

  • Bernardo MarquesEmail author
  • Paulo Dias
  • João Alves
  • Beatriz Sousa Santos
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1026)


Augmented Reality (AR) offers the possibility to present information depending on the context/location: pointing at a given appliance will automatically present relevant interfaces. In this work, we explore Pervasive AR in the context of the Smart Home: users may select the control of a given appliance by pointing at it, simplifying the interaction process. This idea is then extended to consider user profile in the loop: face recognition is used to recognize a given user of and adapt the interface not only to location but also to specific users needs. A preliminary study was conducted to evaluate and validate the concept.


Pervasive Augmented Reality Human-centered interfaces Adaptive user interfaces Face recognition Smart home 



To all participants involved in the case studies, thanks for collaborating in providing essential data and relevant feedback. The present study was developed in the scope of the Smart Green Homes Project [POCI-01-0247-FEDER-007678], a co-promotion between Bosch Termotecnologia S.A. and the University of Aveiro. It is financed by Portugal 2020 under the Competitiveness and Internationalization Operational Program, and by the European Regional Development Fund. This study was also supported by IEETA - Institute of Electronics and Informatics Engineering of Aveiro, funded by National Funds through the FCT - Foundation for Science and Technology, in the context of the project UID/CEC/00127/2019.


  1. 1.
    Wilson, C., Hargreaves, T., Hauxwell-Baldwin, R.: Smart homes and their users: a systematic analysis and key challenges. Pers. Ubiquit. Comput. 19(2), 463–476 (2015)CrossRefGoogle Scholar
  2. 2.
    Kim, K., Member, S., Billinghurst, M., Member, S., Bruder, G., Duh, H.B., Member, S.: Revisiting trends in augmented reality research: a review of the 2nd decade of ISMAR (2008–2017). IEEE Trans. Vis. Comput. Graph. (2018)Google Scholar
  3. 3.
    Pedersen, I.: Radiating centers: augmented reality and human-centric design. In: Arts, Media and Humanities Proceedings - IEEE International Symposium on Mixed and Augmented Reality, ISMAR-AMH 2009, pp. 11–16 (2009)Google Scholar
  4. 4.
    Grubert, J., Zollmann, S.: Towards pervasive augmented reality: context awareness in augmented reality. IEEE Trans. Visual Comput. Graphics 23(6), 1706–1724 (2017)CrossRefGoogle Scholar
  5. 5.
    Abidin, R.Z., Arshad, H., Shukri, S.A.A.: Adaptive multimodal interaction in mobile augmented reality: a conceptual framework. In: ICAST 2017 (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Bernardo Marques
    • 1
    Email author
  • Paulo Dias
    • 1
  • João Alves
    • 1
  • Beatriz Sousa Santos
    • 1
  1. 1.DETI - IEETAUniversity of AveiroAveiroPortugal

Personalised recommendations